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FOREWORD 


This  is  the  second  edition  of  the  procedural  guide  for  applying 
TEPPS  (Technique  for  Establishing  Personnel  Performance 
Standards).  Since  the  first  edition  was  published  in  January  1966, 
additional  methodological  work  has  been  performed  and  a  field  test 
was  conducted  on  a  Navy  CIC  system.  This  edition  incorporates 
the  results  and  findings  of  those  efforts.  For  detailed,  technical 
discussion  of  the  development  and  test  of  TEPPS,  the  reader  is 
referred  to  the  documents  in  the  bibliography. 

The  study  to  develop  and  test  TEPPS  was  performed  under 
the  cognizance  of  the  staff  of  Captain  R.  G.  Black,  USN,  Director, 
Personnel  Research  Division,  Bureau  of  Naval  Personnel. 

Dr.  Martin  Wiskoff,  Head,  Psychological  Research  Branch 
(Pers-A32)  was  Scientific  Officer. 

Responsible  officer  for  Dunlap  and  Associates,  Inc.  ,  was 
was  Dr.  Joseph  W.  Wulfeck.  Dr.  Robert  E,  Blanchard  was 
Project  Director.  Staff  members  were  Dr.  M.  B.  Mitchell, 

Mr.  R.  L.  Smith,  and  Mr.  R.  A.  Westland. 
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I.  INTRODUCTION 


A.  General  Remarks 

Every  system  Is  presumed  to  be  designed  to  accomplish  a  well- 
defined  mission;  therefore  its  success  can  be  stated  objectively  in 

terms  of  specific  criteria.  For  example,  a  radar  system  may  be  f 

designed  to  detect  and  identify  the  type,  range,  and  bearing  of  a 
target  within  certain  range  and  height  limits,  and  also  to  determine 
its  closing  rate.  However,  no  system  performs  perfectly  at  all 
times.  As  a  result,  system  dea*gners  need  to  know  the  operational 
requirements  for  successfully  satisfying  the  criteria  for  mission 
accomplishment.  (It  may  be  critical  that  the  above  radar  system 
accurately  performs  its  mission  90  percent  of  the  time  and  within 
five  minutes  for  each  target.)  System  Effectiveness  Requirements 
(SERs)  for  probability  and  time  imply  that  each  man/machine  opera¬ 
tion  must  meet  minimal  standards  for  the  SER  to  be  met.  TEPPS, 

then,  is  a  method  for  deriving  probability  and  time  standards  for  ; 

identifiable  man/machine  activities  so  that  the  sysf'm  can  meet  its 
overall  SER. 


The  organization  of  this  guide  follows  the  general  outline  of 
approach  shown  in  Figure  1.  That  figure  describes  the  major  proce¬ 
dural  steps  performed  in  applying  TEPPS  for  operator  or  scheduled 
(preventive)  maintenance  tasks.  Starting  with  effectiveness  require¬ 
ments  and  system  descriptive  d;  •*.  the  sequence  of  steps  begins  with 
a  description  of  the  methodology  analyzing  the  system  so  as  to 
represent  it  graphically.  The  g.^r  ‘C  model  can  be  converted  to  a 
mathematical  model  for  use  in  alio  jating  the  system  effectiveness 
requirements  to  definable  system  segments.  However,  if  TEPPS 
computer  program  is  utilized,  construction  of  a  mathematical  model 
is  performed  implicitly  by  the  computer,  which  then  derives  man/ 
machine  performance  standards  based  on  the  results  of  analyzing  the 
mathematical  model  and  the  syotem  operational  requirements.  Since 
the  procedure  for  establishing  standards  for  corrective  maintenance 
tasks  differs  from  that  for  operator  tasks,  it  is  described  separately 
in  Section  V  of  this  guide. 
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Use  of  the  procedures  included  here  rests  primarily  upon  three 
basic  assumption!): 

1.  The  user  has  experience  in  systems  analysis, 
in  general, 

2.  The  user  is  familiar  with  the  specific  system 
being  analysed  to  the  extent  that  he  can  fully 
utilize  the  available  data  describing  the  system,  and 

3.  The  procedures  are  to  be  applied  tc  analysis  and 
evaluation  of  existing  systems  in  contrast  to  system 
conception  and  initial  design.  * 

The  requirement  for  familiarity  with  the  specific  system  is 
important  because  the  analyst  must  be  able  to  perceive  the  system's 
capabilities  objectively  without  being  constrained  by  the  performance 
expected  of  it.  That  is,  he  will  be  called  upon  to  recognize  if  the 
system  might  perform  in  ways  other  than  those  (1)  recorded  in 
documents  such  as  operational  procedures,  or  (2)  carried  out  in 
actual  practice. 

Accurate  application  of  TEPPS  primarily  depends  ujxn  a 
knowledge  of  general  procedural  rules  which  may  apply  at  any  time 
throughout  the  construction  process.  In  order  to  facilitate  under¬ 
standing,  examples  are  presented  frequently.  However,  since  each 
system  (and  therefore  each  application)  is  unique,  examples  should 
not  be  taken  literally,  but  used  as  an  aid  to  understanding  the  basic 
rules  of  system  analysis. 


B  •  Definitions 


Several  concepts  and  terms  which  are  frequently  used  in  this 
guide  are  defined  in  this  section.  Some  of  the  terms  have  been 
developed  specifically  for  TEPPS.  It  is  especially  important  that 
all  definitions  be  thoroughly  understood  before  proceeding  further. 


Since  the  procedural  guide  can  be  modified  to  include  use  of  TEPPS 
for  design,  and  since  the  technique  has  the  potential  as  an  evaluative 
aid  in  design,  there  are  times  throughout  the  guide  when  reference 
is  made  to  the  difference  in  applying  TEPPS  to  existing  systems  as 
opposed  to  those  in  the  process  of  being  designed. 
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System  -  A  System  is  an  operational  set  of  components 
delineated  by  its  input  state,  required  output  state,  and 
constraints.  A  system  includes  all  features  of  that  set 
which  are  affected  by  the  transition  from  input  state  to 
output  state  within  the  constraints  imposed  upon  it.  A 
system  can  be  represented  graphically  by  a  single  complex 
Personnel/Equipment  Function  Unit  (PEF  Unit)  indicated 
by  a  rectangle,  as  shown  in  Figure  2. 


Input  State 

Output  State 

1 .  Search  operator  is 
alert  and  observing 

1.  Target(a)  range, 
bearing,  height 

~adar  scope. 

2.  System  components - 

are  operational. 

RADAR 

SYSTEM 

OPERATIONS 

and  closing  rate 
_  are  recorded. 

2.  Target  is 

3.  System  checkout 
indicates  capability 
for  target  signal 
reception  and  display. 

identified. 

Figure  2.  A  PEF  Unit  at  its  most  general  level. 


•  PEF  Unit  -  A  Personnel* Equipment  Functional  Unit  is  a 
general  term  indicating  man-machine  or  man-man  interaction 
at  any  level  of  specificity,  depending  upon  the  context  of  discus¬ 
sion.  As  opposed  to  a  state,  a  PEF  Unit  represents  one  or  more 
operations,  activities  or  processes.  The  PEF  Units  of  Figure  3 
are  much  more  specific  than  that  of  Figure  2,  in  that  they  describe 
more  detailed  operations  that  must  occur  to  meet  the  required 
system  output. 

•  State  -  A  state  of  a  system  is  identified  by  a  complete  description 
of  the  relevant  and  measurable  characteristics  of  the  system  at  an 
instant  in  time.  The  description  of  the  state  is  always  a  declara¬ 
tive  sentence  including  the  word  "is"  or  "are";  e.  g.  ,  in  Figure  3 
one  of  the  system  input  states  is  'Search Operator  is  observing 
radar  scope.  "  States  are  represented  graphically  as  lines  lead¬ 
ing  to  or  from  boxed  PEF  Units. 


Input  State  -  The  input  state  of  the  system  is  specified  by  initial 
system  conditions  which  can  undergo  change  during  system 
performance;  a  change  may  occur  at  any  time  in  the  system's 
operation  until  the  output  state  is  reached. 

Intermediate  States  -  Intermediate  states  (between  two  or 
more  PEF  Units)  are  all  the  instantaneous  conditions  of  the 
system  which  have  undergone  change  as  a  result  of  the  immedi¬ 
ately  preceding  operation^)  (i.e.  ,  prior  PEF  Unit).  While  only 
changed  features  arc  actually  described  for  intermediate  system 
states,  all  prior  unchanged  conditions  are  assumed.  That  is, 
the  description  of  a  state  implicitly  includes  all  unchanged 
portions  of  the  system  input  state  and  the  last  described  condi¬ 
tion  of  all  features  which  have  been  altered  from  the  system 
input  state. 

Output  State  -  The  output  state  of  the  sytem  is  specified  by  the 
overall  system  requirements.  It  includes  objective  statements 
indicating  the  accomplishment  of  the  system's  objectives.  In 
Figure  3  the  required  system  output  state  is  "orders  for  appro¬ 
priate  action  are  being  processed.  " 

Function  -  The  broadest  description  of  uystem  operations 
(next  to  a  general  statement  of  the  system  itself)  is  made  in 
terms  of  Functions .  A  Function  is  a  PEF  Unit  delineated  by  an 
input  state,  required  output  state,  and  constraints  without  regard 
to  the  specific  hardware  of  personnel  of  the  system.  Frequently, 
a  single  verb  such  as  "detect",  "evaluate",  or  "calibrate" 
suffices  to  define  a  Function. 

Element  -  An  element  is  alternatively  called  an  elemental 
PEF  Unit.  It  represents  the  most  specific  level  of  system 
description  to  which  these  procedures  are  designed  to  be 
applied. 

PEF  Unit  Relations  -  The  relations  among  PEF  Units  are  deter¬ 
mined  by  required  sets  of  input  and  output  states,  possible  alter¬ 
native  output  states  or  alternative  ways  of  making  the  transition 
from  a  given  input  state  to  a  subsequent  output  state.  Refer  to 
Figure  3  for  examples  of  the  following. 
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1)  The  input  state  of  the  PEF  Unit  may  be: 

a)  The  system  input  state  (states  u,  v,  w,  and  x). 

b)  Identical  to  the  output  state  of  an  immediately 
preceding  PEF  Unit  (state  d,  input  to  E.  1). 

c)  Made  up  of  more  than  one  component,  each  of 
which  represents  the  output  state  of  another 
PEF  Unit  (input  to  C.  1). 

2)  Somewhat  overlapping  the  above,  the  output  state 

of  the  PEF  Unit  may  be: 

a)  The  system  output  state  (state  c). 

b)  Part  of  the  input  state  to  a  subsequent  PEF 
Unit  (C.  2  is  part  of  the  input  state  to  D.  1). 

c)  All  of  the  input  state  to  a  subsequent  PEF  Unit 
(state  a  is  adequate  for  B.  1  and  B.  2  or  B.  3). 


GSSM  -  The  Graphic  State  Sequence  Model  (GSSM)  is  a 
diagrammatic  representation  of  the  system  in  detailed  form. 

It  specifies  not  only  what  the  system  is  expected  to  do  but  also 
what  the  system  is  capable  of  doing  To  construct  an  accurate 
model,  therefore,  the  constructor  must  be  thoroughly  familiar 
with  the  system  and  all  documents  associated  with  it.  Figure  2 
illustrates  the  simplest  form  of  GSSM,  but  it  has  very  little 
analytical  value.  Figure  3  is  an  example  of  a  hypothetical 
system  in  more  detailed  GSSM  form.  The  GSSM  may  include 
a  maximum  of  ei'jht  symbols.  Their  explanations  and  the  rules 
for  constructing  a  GSSM  are  presented  in  Section  II. 

MSSM  -  The  Mathematical  State  Sequence  Model  (MSSM)  is  a  set  of 
one  or  more  equations  which  express  the  relation  between  the 
required  probability  of  achieving  the  system  output  state  (i.e.  , 
the  probability  component  of  the  System  Effectiveness  Require¬ 
ment  or  SER)  and  the  probabilities  of  accomplishing  the  PEF 
Units  which  the  system  comprises.  When  stated  explicitly,  the 
MSSM  directly  reflects,  in  equation  form,  the  structure  of  the 
GSSM. 
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Allocation  -  Allocation  refer*  to  the  process  of  resolving  the 
MSSM  and  thus  distributing  the  SER  (System  Effectiveness 
Requirements')  among  the  PEF  Units,  thereby  specifying  the 
probability  and  time  standards  of  pi  rformance  for  those  units, 
Allocation  is  the  first  goal  of  TEPPS, 

*  TEPPS  Computer  Program  -  The  set  of  instructions  for  the 
computer  to  perform  the  mathematical  manipulations  for  deriv¬ 
ing  standards  based  upon  input  data  concerning  (1)  effectiveness 
requirement#,  and  (2)  PEF  Unit  parameters  and  their  contribu¬ 
tions  to  the  GSSM. 

•  Effectiveness  Dimensions  -  Effectiveness  is  broadly  defined  as 
the  degree  to  which  a  system  (or  a  functional  unit  of  a  system) 
achieves  its  stated  objective.  Effectiveness  dimensions  are 
related  directly  to  stated  system  objectives  and  provide  for 
measurement  of  system  (or  functional  unit)  effectiveness.  A 
numerical  value  on  an  effectiveness  dimension  reflects  the 
degree  to  which  the  corresponding  objective  was  fulfilled. 

Among  the  dimensions  of  effectiveness  that  may  be  appropriate 
are  (1)  probability  of  success,  (2)  performance  time,  (3)  perform¬ 
ance  accuracy,  and  (4)  quantity  or  quality  scales.  A  composite 
of  effectiveness  dimensions  may  be  necessary  in  order  to  reflect 
the  system  objective  adequately.  Dimensions  used  to  character¬ 
ize  overall  system  effectiveness  may  or  may  not  translate 
directly  to  the  dimensions  that  characterize  effectiveness  of 

any  particular  system  subdivision  or  lower-level  functional  unit, 

«  Effectiveness  Requirement  (ER)  -  An  effectiveness  requirement 
is  a  stipulated  value  or  magnitude  on  a  given  effectiveness 
dimension  that  must  be  met  or  exceeded  by  a  system  functional 
unit.  When  the  functional  unit  is  the  entire  system,  the  effective¬ 
ness  requirement  is  identified  as  the  System  Effectiveness 
Requirement  (SER).  For  example,  an  effectiveness  dimension 
of  detection  range  might  be  established  for  a  surveillance  system; 
a  value  of  100  miles  might  then  be  stipulated  as  the  SER.  Effec¬ 
tiveness  requirements  also  may  be  stipulated  for  major  functions 
the  system  is  to  perform.  For  the  example  above,  effectiveness 
requirements  may  be  stipulated  for  such  major  functions  as 
target  identification,  classification  and  threat  assessment 
(effectiveness  dimensions).  When  the  functional  unit  is  a  PEF 
Unit  at  a  subsystem  level  (or  lower),  effectiveness  requirements 
arc  not  stated  but  are  derived  from  those  stated  at  the  function  or 
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overall  system  level  using  an  allocation  model.  Effectiveness 
requirements  may  take  the  form  of  a  single  value  on  r>n  effec¬ 
tiveness  dimension,  or  under  certain  circumstances  several 
values  may  be  defined  representing  levels  of  effectiveness 
(degrees  of  system  success)  which  arc  acceptable  under  speci¬ 
fied  conditions  for  that  system.  For  cases  in  which  more  than 
one  effectiveness  dimension  is  required  to  reflect  the  system 
objective,  the  ER  is  a  series  of  numerical  values  such  as  a 
required  probability  for  meeting  the  system  objective  within  a 
given  accuracy  tolerance  within  a  given  time.  In  some  instances, 
the  ER  may  represent  an  index  resulting  from  the  mathematical 
combination  of  values  on  several  effectiveness  dimensions, 

•  R edundancy  -  Redundancy  refers  to  a  duplication  of  system 
operations.  Redundancy  occurs  when  there  arc  two  or  more 
PEF  Units  (or  two  or  more  sequences  of  PEF  Units)  within  a 
system  that  give  rise  to  essentially  identical  outputs,  the  occur¬ 
rence  of  only  one  of  which  is  necessary  to  mission  success. 
Redundancy  PEF  Units  (or  sequences  of  PEF  Units)  may  have 
the  same  or  different  effectiveness  levels  and  may  or  may  not 
involve  the  same  operations. 

•  Personnel  Performance  Standard  (PPS)  -  A  personnel  perfor¬ 
mance  standard  comprises  a  description  of  a  Personnel-Equipment 
Elinctlonal  Unit  (PEF  Unit)  and  an  associated  numerical  value 
established  on  an  appropriate  performance  dimension  for  that 
PEF  Unit.  The  performance  dimension  is  related  directly  to 

the  system  effectiveness  dimension  and  to  the  System  Effective¬ 
ness  Requirement  (SER).  Meeting  or  exceeding  the  derived 
personnel  perfoi . nance  standard  is  necessary  for  the  SER  to 
be  realized.  Among  the  dimensions  that  may  be  appropriate 
are  (1)  performance  accuracy,  (2)  performance  time  (1)  quantity 
or  r*te  of  output,  and  (4)  quality  of  output.  The  type  of  PEF 
Unit  outputs  are  many  and  varied,  but  may  be  classified  as 
(1)  true  dichotomous  distributions,  (2)  artificially  dichotomous 
distributions,  and  (3)  continuous  distributions.  For  all  types  of 
dimensions,  a  probabilistic  statement  can  be  made  relative  to  the 
achievement  of  a  particular  value  on  that  dimension.  In  general, 
the  current  state-of-the-art  is  represented  by  the  probabilistic 
approach.  Examples  of  various  forms  of  PPS  are: 
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Accuracy: 

"Adjust  amplifier  balance  to  zero 
within  ±  S  mv" 

Time: 

"Remove  and  replace  defective 
circuit  card  within  2.  S  minutes" 

Rate: 

"Log  and  file  25  incoming  messages 
per  hour*1 

Quality: 

"Expose  oscillograph  paper  to  light 
and  judge  the  acceptability  of  the 
resultant  traces" 

The  above  dimensions  could  be  treated  as  artificial  dichotomies , 
i.c.  ,  the  required  performance  level  was  or  was  not  achieved 
(pass/fail),  Or,  a  probabilistic  statement  could  be  made  concern¬ 
ing  the  required  performance  level)  for  example; 

"Adjust  amplifier  balance  to  zero  within  ±  5  mv 
with  probability  =  .  90" 

Such  a  requirement  statement  indicates  that  personnel  assigned 
to  perform  the  PEF  Unit  could  fail  to  achieve  the  required 
accuracy  level  10  times  in  100  and  the  SER  could  still  be  realized. 


C.  TEPFS  Input  Data  Requirements 

The  three  general  types  of  input  data  required  for  full  employment 
of  TEPPS  are  discussed  below  along  with  potential  data  sources, 

1 .  System  Effectiveness  Requirements  (SER) 

SERs  established  for  the  system  specify  the  extent  to  which 
the  system  is  expected  to  achieve  stated  mission  requirements.  They 
constitute  a  quantitative  description  of  what  functions  the  system  is  to 
perform  and  how  well  it  must  perform  them.  SERs  represent  the 
ultimate  criteria  against  w'hich  system  performance  is  measured  and 
are  used  as  the  basis  for  establishing  personnel  performance  standards. 
Three  major  classes  of  requirement  measures  are: 
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a.  General.  Overall  effectiveness  requirement, 
v.g.  .  probability  of  accompli shi ng  the  mission  for  which  the  system 
was  designed,  where  the  mission  may  be  defined  along  one  or  more 
dimensions  such  as  number  of  radar  target,  identifications,  accuracy 
and  time  to  make  them. 

b.  Performance .  Required  ability  of  the  system 
to  achieve  specific  operational  objectives  giver,  that  the  system  is 
ope ra ting .  This  class  of  requirements  is  usually  associated  with 
major  system  functions,  e.g.  ,  for  a  radar  system,  probability  and/or 
time  requirements  for  such  functions  as  detection  and  tracking. 

c .  Availability /Dependability,  Required  expectancy 
for  system  operation  at  a  given  point  in  time  during  the  mission  (system 
duty  cycle).  For  example: 

A  =  MTBF  /(MTBF  t  MTTR) 

where: 

MTBF  s  Mean  Time  Between  Failures 

MTTR  =  Mean  Time  To  Restore 


The  level  of  detail  and  completeness  of  SER  input  data  will 
vary  as  a  function  of  the  type  of  system  under  study,  the  particular  step 
in  the  RDT&E  process  at  v'hich  TEPPS  in  introduced  and  the  degree  to 
which  system  requirements  studies  have  been  performed.  Usually, 
operational  requirements  evolve  in  hierarchical  fashion.  Early  in  the 
life  of  a  system,  they  are  likely  to  be  stated  in  rather  gross  terms. 

As  system  design  and  development  proceed,  requirements  data  evolve 
to  more  specific  and  detailed  statements. 

To  be  most  useful  in  design  trade-off  analyses,  TEPPS 
must  be  introduced  early  in  the  design  process;  however,  its  applica¬ 
tion  depends  upon  the  availability  of  SER  data.  The  Proposed  Techni¬ 
cal  Approach  (PTA)  stage  is  a  likely  start  point  for  TEPPS  application. 
If  system  requirements  data  are  not  on  hand,  then  TEPPS  must  await 
requirements  determination  studies  performed  as  part  of  PTA  prep  ra¬ 
tion. 


-  11 


In  instances  where  requirements  documentation  it  limited, 
consideration  should  be  given  to  using  interviews  with  representatives 
of  Navy  "purchaser"  of  the  system.  Estimates  of  system  requirements 
obtained  from  expert  judges  can  be  used  aa  starting  points  for  1  EPPS  analy¬ 
sis.  Based  on  feedback  from  TEPPS  use,  these  data  can  be  modified, 
refined,  or  revised  as  need  be  by  the  originator.  Limited  documented 
requirements  data  need  not  necessarily  preclude  TEPPS  application. 

It  may  increase  the  liaison  effort  required  with  certain  Navy  activities; 
however,  considering  the  potential  gain,  such  additional  effort  would 
seem  to  be  justified. 

General  sources  of  system  requirements  data  include: 

•  Mission  requirements  studies. 

•  System  effectiveness  studies. 

•  Enemy  capability  analyses. 

•  Interviews  and  liaison  with  representatives 

of  CNO.  CNM,  and  the  Principal  Development 
Activity. 


Sources  specific  to  the  Navy's  RDT&E  documentation 
process  are:1 

•  Task  reports  resulting  from  research  on  an 
exploratory  development  requirement  (EDR)  or 
a  general  operational  requirement  (GOR). 

•  Tentative  Specific  Operational  Requirement  (TSOR). 

•  Proposed  Technical  Approach  (PTA). 

•  Advanced  Development  Objective  (ADO). 

•  Specific  Operational  Requirement  (SOR). 

•  Technical  Development  Plan  (TDP). 


*For  further  informatioi.  on  these  RDT&E  documents,  see  OPNAV 
Injtruction  3900.  8B,  Planning  Procedures  for  the  Navy  Research 
Development,  Test  and  Evaluation  (RDT&E)  Program. 
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This  type  of  input  data  includes  any  and  all  information  that 
ser\'es  to  describe  the  functional  design  of  the  system  arid  its  manner 
of  operation.  System  descriptive  data  help  define  the  design  approaches 
to  fulfilling  the  SERb  imposed  on  the  system  and  the  allocation  of  system 
functional  requirements  among  man  and  machine.  These  data  provide 
the  basis  for  constructing  the  Graphic  State  Sequence  Model  (GSSM)  for 
TEPPS.  Typical  sources  of  system  descriptive  data  are: 


•  System  predesign  reports  ar.d  memoranda. 

•  Mission  analysis  reports, 

•  Function  definition  and  system  flow  diagrams. 

•  System  design  specifications. 

•  Development  and  test  reports. 

•  Operating  and  maintenance  procedural  documents. 

•  Personnel  planning  information  documents. 

•  Liaison  with  engineering  design  personnel. 


Similarly  to  SER  data,  system  descriptive  data  evolve  in 
level  of  detail  and  comprehensiveness  as  system  design  and  develop¬ 
ment  proceeds.  In  the  early  stages  of  system  design,  such  informa¬ 
tion  is  likely  to  be  stated  in  rather  general  terms  with  limited  documen¬ 
tation.  Full  utilization  should  be  made  of  liaison  with  cognizant  design 
personnel  to  obtain  information  necessary  for  TEPPS  application  as 
early  as  possible  in  the  design  process. 


Human  capability  data  are  necessary  in  order  to  determine 
the  effect  on  system  effectiveness  of  personnel  performance  levels  that 
deviate  from  established  performance  standards.  Such  data  represent 
available  personnel  capabilitier  (resources)*  and  when  compared  to 
established  performance  standards  provide  an  estimate  of  the  degree 
to  which  system  effectiveness  requirements  can  be  fulfilled.  At 
present,  no  comprehensive  and  fully  reliable  store  of  human  perfor¬ 
mance  data  is  available.  In  the  absence  of  an  applicable  data  store, 
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capability  data  can  be  obtained  on  the  specific  personnel  group  being 
considered  for  assignment  to  the  system  by  measuring  the  performance 
of  that  group  on  the  man-machine  activities  resulting  from  the  standards 
allocation  process.  Other  sources  would  be  (1)  proximate  data  obtained 
from  previous  studies  of  personnel  activities  comparable  to  those 
required  by  the  system  under  study,  (2)  simulation  studies  involving 
the  personnel  activities  under  study,  and  (3)  judgments  made  by  experts 
intimately  familiar  with  the  performance  of  the  personnel  group  xmder 
consideration  on  identical  or  similar  activities  in  other  systems. 

Subjective  judgment  techniques  (method  of  paired  compari¬ 
sons),  in  conjunction  with  an  appropriate  transformation  equation, 
have  been  employed  successfully  to  obtain  estimates  of  the  probability 
of  accomplishing  man-machine  activities^.  Human  capability  data 
derived  in  that  manner  have  been  used  in  an  application  of  TEPPS  to 
a  Navy  CIC  subsystem**. 

In  order  to  apply  TEPPS  Computer  Program  for  allocation 
of  requirements  so  as  to  derive  standards,  it  is  currently  necessary 
that  human  capability  data  be  available  in  the  following  form, 

(1)  Activity  description,  ronsi"ti*nf  with  the 
description  of  a  system  —  required  activity. 

(2)  An  identification  number  associated  with 
that  activity  description. 

(3)  Estimated  maximum  probability  with  which  the 
activity  can  be  performed  correctly  by  a  given 
population. 

(4)  The  "minimum"  time  and  "maximum"  time  to 
accomplish  the  activity  by  the  assumed  population. 
Tho.,e  time  values  are  assumed  to  be,  respectively, 
at  minus  and  plus  three  standard  deviations  from 
the  mean  of  a  lognormal  distribution  of  performance 
times. 


^Blanchard,  R .  E.  ,  Mitchell,  M.  B.  ,  &  Smith,  R.L.,  Likelihood- Of - 
Accomplishment  Scale  For  A  Sample  Of  Man-Machine  Activities, 

Dunlap  and  Associates,  Inc.  ,  Santa  Monica,  California,  June  1966. 

^Mitchell,  M.B.,  Smith,  R.L.,  t  Blanchard,  R.E.,  Test  Application  Of 
TEPPS  On  A  Navy  CIC  Subsystem,  Dunlap  and  Associates,  Inc.  , 

Santa  Monica,  California,  August  1967. 
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II.  CONSTRUCTING  THE  GRAPHIC  STATE  SEQUENCE  MODEL  (GSSM) 


A.  Introduction 


The  principal  purpose  of  constructing  a  diagrammatic  representation 
of  a  system,  is  to  provide  a  clear  and  complete  basis  for  performing 
logical,  objective  analysis  of  a  system.  By  reducing  the  system  to  its 
sequence  of  instantaneous  states  and  transitional  PEE  Units,  the  GSSM 
establishes  a  framework  which  permits  the  analyst  to  view  an  existing 
system  not  only  as  it  was  designed  to  operate,  but  also  as  it  is  poten¬ 
tially  capable  of  operating.  If  complete,  the  GSSM  provides  all  neces¬ 
sary  information  for  representing  the  system  symbolically  to  a  computer 
so  that  it  can  perform  the  necessary  operations  to  allocate  system  effec¬ 
tiveness  requirements  and  derive  performance  standards.  Alternatively, 
the  GSSM  enables  construction  of  a  corresponding  Mathematical  State 
Sequence  Model  (MSSM)  which  enables  manual  derivation  of  standards 
and  which  can  aid  interpretation  of  the  results  of  allocation. 

A  MSSM  generated  either  by  the  computer  or  an  analyst  is  a  direct 
reflection  of  the  GSSM.  Therefore,  it  is  particularly  important  that  the 
GS3M  represent  the  system  completely  and  include  all  necessary  states 
and  all  important  operations  --in  the  form  of  PEF  Units  --of  which  the 
system  is  capable.  An  accurate  GSSM  not  only  maps  the  system  correctly 
aut  also  permits  the  evaluation  of  alternative  approaches  to  reaching  a 
given  output  state.  For  example,  even  though  the  procedures  call  out  a 
specific  activity  (PEF  Unit)  which  may  be  sufficient  to  achieve  a  particular 
output  state,  another  PEF  Unit  may  be  more  appropriate  in  terms  of 
overall  probability  of  accomplishment  and/or  time  constraints. 

B.  Symbols  Used  in  the  Graphic  Model 

The  GSSM  comprises  nine  primary  components  to  symbolize  the 
system  process,  states,  and  their  interrelations.  Definitions  of  the 
symbols  appear  in  Table  1.  Figure  4,  which  follows  Table  1,  elaborates 
on  some  of  the  definitions  by  illustrating  representative  examples  in 
which  the  symbols  are  used. 

C.  Preliminary  Procedures 

Preparations  for  constructing  the  actual  graphic  model  include  gather¬ 
ing  and  organizing  all  necessary  available  information.  It  can  usually  be 
expected  that  additional  data  might  be  needed  as  GSSM  development  pro¬ 
gresses,  since  proper  construction  generally  reveals  facets  of  the  system 
not  otherwise  apparent.  To  minimize  later  footwork,  the  following  data 
should  be  gathered  before  beginning  the  GSSM. 
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Tabic  1 


Definitions  of  GSSM  Components 


"HA1 


Rectangle  symbol  indicates  a  PEF  Unit 
that  must  occur  for  the  system  to  change 
from  state  y  to  a  required  state  z. 

An  arrowed  line  indicates  (1)  a  transient 
state,  i.e.,  all  relevant  measurable 
characteristics  of  the  system  at  an 
instant  in  time,  and  ( Z )  the  direction 
toward  which  that  state  leads. 

Dot  symbol  indicates  that  a  single  state  is 
necessary  and  sufficient  to  give  rise  to 
two  or  more  independent  and  system- 
required  PEF  Units  which  may  occur 
either  simultaneously  or  in  any  order. 

The  open  circle  is  an  AND  symbol  indicating 
that  two  or  more  independent  states  must 
exist  simultaneously  to  become  the  effective 
input  state  for  a  subsequent  PEF  Unit.  In 
the  accompanying  figure  the  necessary 
and  sufficient  input  state  for  D  is  the 
simultaneous  existence  of  state  a  and 
state  b  and  state  c. 

Circle  with  X  symbol  indicates  that  a  single 
state  is  associated  with  only  one  of  two  or 
more  mutually  exclusive  PEF  Units: 

As  an  input  symbol,  it  indicates  that  the 
state  is  necessary  and  sufficient  to  give 
rise  to  one,  and  only  one  of  two  or  more 
alternative,  mutually  exclusive  occurrences. 
In  the  adjoining  figure,  state  y  can  lead  to 
the  occurrence  of  either  Aj  or  A^  or  A-j. 
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Table  1  (continued) 


As  an  output  symbol,  the  circle  with  X 
indicates  that  a  given  state  may  arise 
fr.*m  one  and  only  one  of  two  or  more 
alternative,  mutually  exclusive 
occurrences.  In  the  adjoining  figure, 
state  2  may  result  from  either  Aj  or 
A2orA3. 


1 

% 

-  i 

A 

9 


Circle  with  triangle  symbol  indicates  that 
only  one  state  may  exist  from  among  two 
or  more  possible  states  at  the  same  point 
in  the  system's  operation: 


As  an  input  symbol,  it  indicates  that 
a  single  PEF  Unit  may  give  rise  to  one 
and  only  one  of  two  or  more  alternative 
states,  each  of  which  may  --  at  one  time 
or  another  --  be  normal  to  the  system 
operation.  In  the  figure,  either  state 
zi  or  *2.21  z3  result  from  PEF  Unit 
A  under  normal  operating  conditions. 

As  an  output  symbol,  it  indicates  that 
there  are  two  or  more  mutually  exclusive 
states  each  of  which  are  both  necessary 
and  sufficient  to  give  rise  to  a  given 
PEF  Unit.  In  the  adjoining  figure,  activity 
D  depends  upon  either  state  yj  or  state 
yz  o£  state  y3.  * 


The  circle  with  X  input  symbol  differs  from  the  circle  with  triangle  symbol 
in  the  following  ways:  The  input  (jj)  usually  indicates  system  capabilities 
in  the  sense  that  only  one  of  the  PEF  Units  following  that  symbol  need 
ever  occur  --  the  others  conceivably  could  be  eliminated.  The  @  symbol 
indicates  that  the  system  may  always  be  expected  to  assume  one  of  two 
or  more  states  as  a  result  of  a  particular  PEF  Unit.  (See  examples  in 
Figure  4. )  It  may  be  noted  that  the  <s>  symbol  is  implied  for  the  output 
of  every  PEF  Unit  in  the  system,  in  that  the  required  state  may  not 
arise,  possibly  due  to  a  failure  condition.  Since  it  is  always  implied, 
the  symbol  usually  is  omitted  with  the  understanding  that  if  the  specified 
state  does  not  occur,  maintenance  activities  will  ensue.  It  is  where 
there  are  possible  states  other  than  those  leading  to  maintenance  that 
the  @  symbol  is  used. 
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cate*  redundant  procedures  to  produce 
the  transition  between  w  and  y.  In 
effect,  A+B+C  increase  the  likelihood 
of  the  functional  accomplishment  of 
A+B;  or  vice  versa. 


Dashed  line  Bymbol  indicates  a  state 
which  leads  to  a  repetition  of  a  pre¬ 
viously  performed  set  of  activities  in 
a  cyclical  manner.  In  the  accompanying 
figure,  the  sequence  A-then-B  is  to  be 
repeated  if  state  "y  exists. 


Arrowed  line  with  circle  symbol  indicates 
simultaneous  identical  operations  --  and 
intermediate  states  --  in  two  or  more 
independent  subsystems.  In  the 
accompanying  figure,  the  sequence  A- 
then-B  occurs  in  three  different  parts  of 
the  system  (A-»B  and  two  more  in  parallel), 
the  input  Btate  for  C  is  the  summation  of 
the  output  states  of  the  three  subsystems. 
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1.  Overall  system  effectiveness  requirements 

The  precise  final  output  state  cf  the  System 

Probability  required  for  the  final  output  state  * 

.  Time  limitations  from  onset  to  completion  of  system 
functioning  /if  applicable) 

2.  Specific  system  effectiveness  requirements 

.  The  precise  output  state  at  any  intermediate  stage  of 
system  operation  for  which  effectiveness  requirements 
have  been  established  (if  applicable) 

.  Probabilities  required  for  intermediate  system  states 
(if  any  are  available) 

Time  limitation  for  the  transition  from  one  intermediate 
state  to  another  (if  any  are  available) 

3.  Input  state  conditions,  i.e.  ,  complete  description  of  the  relevant 
system  just  prior  to  its  initiation 

4.  System  constraints,  either  specified  or  assumed. 

Each  of  the  above  types  of  data  will  be  illustrated  later  in  an  example. 


D,  Alternative  Construction  Procedures 


There  are  two  primary  ways  to  begin  constructing  a  GSSM:  (1)  Li6t 
all  states  and  PEF  Units  in  sequential  order  on  data  forms  before  pro¬ 
ceeding  to  the  GSSM,  or  (2)  Begin  immediately  to  construct  the  GSSM  on 
a  "trial  and  error"  basis;  i.  e.  ,  start  with  a  rough  model  and  continue  to 
refine  it  until  it  completely  and  accurately  represents  the  system.  The 
first  method  has  the  advantage  of  aiding  or  organizing  and  preserving 
the  logical  step-by-step  procedures  employed  in  this  guide,  while  the 
second  may  enable  some  analysts  to  conceptualize  PEF  Unit  interrela¬ 
tions  more  easily.  However,  since  it  cannot  be  predicted  which  method 
may  be  more  satisfactory  for  a  given  analyst  it  is  recommended  that  he 
proceed  via  the  Graphic  Model  Data  Form  (GMDF)  technique  upon  applying 
TEPPS  for  the  first  time. 


Tolerances,  or  accuracy  requirements  associated  with  the  final  or  inter¬ 
mediate  system  states  are  assumed  optimal  when  considering  probability 
requirements. 
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Generally,  the  information  nccosnary  for  constructing  the  Graphic 
Modei  Data  Form#  or  the  GSSM  is  likely  to  be  available  in  the  form  of 
operational  procedures  for  a  system  which  already  exists.  However, 
some  operations  may  occur  which  are  not  specified  formally,  and  it  i# 
therefore  necessary  for  the  analyst  to  include  that  information  through 
observation  and/or  general  knowledge  of  the  system. 

E,  Organizing  Data  on  Graphic  Model  Data  Forms 

The  purpose  of  the  Graphic  Model  Data  Form  (GMDF)  is  to  organize 
existing  information  regarding  the  human  contribution  to  system  per¬ 
formance  in  a  format  that  will  facilitate  subsequent  GSSM  construction. 

The  GMDF  does  not  guarantee  complete  information  about  a  system;  the 
analyst  will  need  to  exercise  considerable  care  in  constructing  the  GSSM 
whether  or  not  Data  Forms  arc  utilized.  The  Forms  only  organize 
existing  data,  and  do  not  indicate  errors  or  omissions. 

Figure  5  illustrates  the  recommended  headings  for  the  GMDF  columns. 
The  meaning  of  those  headings  will  be  clarified  in  the  following  discussion. 


Graphic  Model  Data  Form 


Function _ 

Probability _ Time 


PEF 

Unit 

No. 

Prior 

Necessary 

Step(s) 

Alter¬ 

nate 

Step{s) 

Activity  Description 

Output 

State 

Imposed  Requirement 

_ (SER) _ 

P 

T 

Figure  5.  Recommended  headings  for  the  GMDF. 
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Stop  1:  Analysis  at  the  Function  Level 


On  the  first  GMDF,  cross  out  "Function"  and  write  "System"  at  the 
top.  Thio  data  form  will  contain  the  initial  breakdown  of  the  system  into 
Functions  and  inter-Functiun  states.  Following  "Probability"  and  "Tima," 
list  the  overall  system  effectiveness  requirements  which  were  prepared 
in  Section  II.  C.  Divide  the  system  into  Functions  by  specifying  as  many 
gross  system  states  as  can  bo  identified;  if  possible,  assign  general 
activity  states  to  the  mediating  PEF  Units  in  accordance  with  the 
definition  of  a  Function  in  Section  I.  B. 

a.  Assign  a  capital  letter  to  each  Function,  starting  with  "A" 
and  place  those  letters  under  the  heading  "PEF  Unit  Number," 

b.  Under  "Prior  Necessary  Step(s)"  list  the  letter  code  for  the 
Function(s)  required  in  order  that  the  needed  input  state 
evicts.  For  example,  if  PEF  Units  B  and  C  are  parallel 
Functions  coming  after  A,  then  the  prior  necessary  step  for 
both  B  and  C  will  be  "A,"  because  A  provides  the  required  input 
state  for  C  as  well  as  for  B.  (See  relation  No.  4  in  Figure  4 

on  page  17). 

c.  List  whether  alternate  Functions  exist  ("yes"  or  "no").  In 
the  examples  above,  state  "no"  for  all  three  functions. 

However,  if  B  and  C  are  mutually  exclusive,  then  "yes" 
should  be  indicated  in  the  column  headed  "Alternate  Step(s)" 
for  both  B  and  C.  (See  relation  No.  5  in  Figure  4.) 

d.  Under  "Activity  Description"  name  the  Function  in  a  single 
word  verb,  or  a  brief  verb  phrase,  indicating  the  general 
operation,  e.  g.  ,  "detect,  "  or  "checkout  of  equipment  X," 

e.  Specify  the  output  state  of  each  function  in  relation  to  its  input 
state,  i.  e.  ,  describe  only  those  conditions  which  have  been 
altered  from  previously  specified  and  implied  conditions. 

f.  Under  "Imposed  Requirements  (SER)"  enter  probability  (P) 

and,  if  applicable,  time  (T)  components  of  the  system  effectiveness 
requirements,  under  P  and  T,  respectively.  Those  values  will 
have  been  listed  according  to  the  procedures  in  Section  II.  C. 

Example  of  Step  1 

The  following  hypothetical  example  illustrates  the  technique  in  skeletal 
form  in  order  to  be  brief.  A  more  complete  example  would  give  detailed 
data. 
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System: 


Bench  checkout  of  electronic  item  X  (a  relatively  complex  electronic 

device) 

a.  Requirements: 

1)  The  list  of  criteria  to  be  met. 
those  output  state  criteria  wo\ 
effect,  the  output  state  describe. 

X  is  read/  for  installation. ) 

2)  Time  limitation  for  entire  checkout  (if  applicable), 

3)  Probability  required  for  successful  checkout. 

b.  Input  state  conditions: 

1)  Checkout  equipment  are  available.  (Th  e  should  be 
itemized. ) 

2)  X  is  on  bench. 

3)  Technician  has  checkout  procedure  manual  open  to 
first  page  of  instructions. 

4)  Required  power  is  available  at  the  bench  (specify;  e.  g. , 

10  V.D.C;  115  VAC,  60  cps). 

c.  Intermediate  characteristics:  (In  checkout  procedures,  these 

are  generally  specified  by  the  output  criteria,  as  listed  under 

"Requirements"  above. ) 

d.  Constraints: 

1)  Environmental  conditions  (temperature,  noise,  illumination, 
etc. )  are  within  tolerance  range  of  technician  and  hardware. 

2)  Checkout  table  is  not  made  of  any  material  which  conducts 
electrical  current. 

3)  Technician  stands  on  rubber  mat  during  checkout. 


a  ealistic  example, 
eti  illy  be  stated,  in 
rnditions  such  that 
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e.  Established  Functional  code  designations  and  states  (see  Figure  6). 

A  Necessary  items  of  checkout  equipment  are 

set  up  for  maximum  effectiveness. 

B  ►  All  equipment  are  activated. 

C  . Checkout  measurement  requirements  are 

satisfied. 


D  . X  is  ready  for  installation. 

Graphic  Model  Data  Form 
SYSTEM 

•Function  Bench  Checkout  of  X _ 

Probability  Po _  Time 


* 

t 

i 

i 

i 

* 


5  rt'-  #! ft ;  ■ilMW- }  H  *  aw  U . 


Step  Z'  Analysis  at  the  Element  Lave  I 


One  rnay  proceed  direc*!y  to  the  elemental  level  of  system  description, 
or  one  may  describe  PEF  Units  at  a  level  of  specificity  intermediate 
between  Functions  and  elements,  depending  upon  the  complexity  of  the 
system.  For  large  complex  systems,  intermediate  levels  may  need  to  be 
generated  in  order  to  be  able  to  manage  further  analysis  accurately  down 
to  the  elemental  level.  For  example,  "Bench  Checkout  of  X"  may  be 
considered  a  subfunction  of  "Checkout"  of  a  very  large  system  which 
involves  design,  construction  and  checkout  of  many  pieces  of  equipment. 

The  notation  which  is  used  to  designate  levels  of  specificity  is 
illustrated  in  Figure  7  below.  Note  that  the  first  level  (left  hand  letter) 
refers  to  Functions  and  the  last  level  (right  hand  number)  to  Elements; 
intermediate  levels  are  designated  by  additional  numbers  between  those 
two. 


Systems  may  be  analyzed  to  two  or  more  levels,  and  different 
numbers  of  levels  may  be  used  for  different  systems.  As  a  rule,  for 
any  one  system,  the  same  number  of  levels  should  be  used  throughout  the 
analysis  so  as  to  avoid  confusion;  as  a  result,  there  may  be  some  Functions 
with  intermediate  zero  designations,  indicating  direct  breakdown  to  the 
element  level.  In  the  example  to  be  presented  later  in  this  section,  only 
two  levels  of  specificity  are  indicated;  B.  3,  for  example  will  represent 
the  third  element  of  Function  B. 


Levels  of 
Specificity 

1 

Function 

2  t  3 

Intermediate 

4 

Element 

Example  of 
PEF  Unit 
Notation 

C 

1 

2 

5 

Explanation 

(Third 

Function) 

(First  gross 
operation 
under  functioi 
C) 

(Second 
activity  under 
i  the  first  gross 
operation 
under  function 
C) 

(Fifth  element 
under  the 
second  activity 
under  the  first 
gross  operation 
under  function 
C) 

Example 

Checkout 

Bench 
checkout  of 

X 

Supply  power 
to  dCjuipment 

Place  ON-OFF 
switch  on  X  in 
ON  position 

Figure  7.  The  four  levels  of  specificity  of  a  hypothetical  four¬ 
digit  PEF  Unit  (C.  1.  2.5).  (Designation  of  the  fifth 
element  under  the  second  activity  under  the  first 
operation  under  the  third  function  of  the  system. ) 
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1.  At  the  top  of  the  GMDF,  identify  the  Function  to  be  analyzed  (with 
its  name  and  code  letter). 

2.  Referring  to  the  operational  procedures,  assign  a  number  to 
each  procedural  step.  (For  Function  A,  the  first  step  would  be 
A.  1,  the  second  A.  2,  etc.) 

3.  Under  "Prior  Necessary  Step(s)"  list  the  code  number  of  the 
previous  stop(s)  that  must  have  been  accomplished  before  this 
step  can  possibly  be  performed,  according  to  the  operational 
procedures. 

4.  Under  "Alternate  Step(s)"  indicate  whether  or  not  an  alternate 
approach  may  be  taken  to  arrive  at  the  output  state. 

5.  Describe  the  man/machine  operation  clearly  and  completely 
under  "Activity  Description. " 

6.  Under  "Output  State"  describe  all  measurably  altered  features 
of  the  system  resulting  from  the  prior  activity. 

Example  of  Step  2 

Referring  to  the  earlier  example  presented  to  illustrate  Step  1,  we 
will  look  only  at  Function  B,  "Supply  Power  to  Equipment,"  in  Figure  8. 


F.  Procedures  for  Constructing  the  GSSM 
1,  Introduction 


A  major  consideration  in  developing  a  graphic  representation  of 
a  system  is  organization  of  the  model.  For  even  relatively  small  systems 
a  GSSM  is  likely  to  be  tightly  packed  with  symbols  and  verbal  descriptions 
of  PEF  Units  and  states.  Construction  problems  can  be  considerably 
reduced  if  major  states  of  the  system  define  transitional  segments  (e.g.. 
Functions)  which  are  diagrammed  separately  on  clearly  identified  chart 
boards.  Even  so,  as  chart  boards  accumulate,  it  will  probably  be 
necessary  to  make  repeated  revisions  and  additions  throughout  until  each 
segment  is  well  organized  and  accurately  modeled  on  its  respective  chart 
board. 


It  is  assumed  that  the  analyst's  goal  is  to  construct  the  GSSM  at 
the  elemental  level.  If  the  procedures  were  fbllwed  in  Section  E,  the 
completed  GMDF  would  contain  a  major  portion  of  the  information  needed 
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Function  ___ 
Probability 


Alter¬ 

nate 

Step(s) 


Graphic  Model  Data  Form 

B.  Supply  Power  to  Equipment 
P  Time 


Activity  Description  ^ 

Output  State 

Throw  toggle  switch  TS  on  power 
Supply  PSi  to  ON  position  and  note 
that  AC  ON  lamp  is  lit. 

PSjis  in  warm¬ 
up  condition 

Throw  toggle  switch  TSj  on  power 
supply  PS^  to  ON  position  and  note 
that  AC  ON  lamp  is  lit. 

PS?  is  in  warm¬ 
up  condition 

Throw  toggle  switch  TSj  on  equip¬ 
ment  Gj  ^  to  ON  position  and  note 
that  ON  lamp  is  lit. 

Gj  is  operative 

Throw  toggle  switch  TS^  on  equip¬ 
ment  G2  to  ON  position  and  note 
that  ON  lamp  is  lit. 

G<>  is  operative 

Same,  except  Bwitch  TS^  on  G^. 

G3  is  operative 

Push  button  on  equipment  G4  and 

note  that  ON  lamp  is  lit. 

G4  is  operative 

(Three  minutes  after  B.  1  &  B.  2) 
throw  toggle  switch  TS2  on  power 
supply  PSj  to  ON  position  and  note 
that  DC  ON  lamp  is  lit. 

PSj  is  operative 

1 

1 

. . .  .  . ( 

Same,  except  switch  TS2  on  PS2. 

PS2  is  operaii.ee 

Throw  toggle  switch  TSj  on  X  to  ON 
position  and  note  that  ON  lamp  is  lit. 

X  is  operative 

Imposed 
Require* 
ments 
P  j  T 


While  alternate  approaches  may  be  possible,  if  the  procedures  do  not  indicate  that  fact, 
none  are  listed;  they  will  need  to  be  included  in  the  GSSM,  however. 

All  activities  at  the  elemental  level  should  correspond  with  those  contained  in  LAMA 
in  terms  of  level  of  specificity  and  verbal  description. 

G}  and  G^  may  be  such  gear  as  VTVM  and  audio  oscillator  needed  for  the  checkout  of  X. 
Figure  8.  Example  GMDF  of  a  Function  showing  elemental  PEF  Units. 
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for  such  construction.  Moreover,  since  Functions  end  their  resulting  states  — 
as  well  as  most  of  the  states  arising  from  elements  --  would  have  been 
described,  the  analyst  would  be  able  to  make  a  good  estimate  as  to  the 
amount  of  material  that  will  be  included  on  a  single  chart. 

2.  Construction  Rules 


Independent  of  the  level  of  specificity  at  which  the  GSSM  is  con¬ 
structed  <-»  whether  it  be  at  the  functional,  elemental  or  some  intermediate 
level  --  the  unit  of  construction  is  the  Personnel/Equipment  Functional 
Unit,  designated  by  its  input  and  output  states,  it  is  unique  to  the  Graphic 
State  Sequence  Model  (and  critical  to  its  construction)  that  the  states  of 
the  system  play  the  primary  role.  When  accurately  and  completely  des¬ 
cribed,  the  states  allow  for  an  objective  examination  of  all  reasonable 
means  by  which  the  transition  can  be  made  between  the  input  and  output 
states  of  a  given  PEF  Unit.  Associated  with  those  state /activity  units  of 
construction  are  basic  rules  for  ensuring  accuracy  and  completeness  of 
the  model.  To  apply  those  rules  is  the  primary  task  of  the  analyst;  since 
the  same  rules  must  be  used  repeatedly  for  each  and  every  PEF  Unit,  they 
must  become  part  of  the  analyst's  basic  vocabulary.  To  best  achieve  firm 
familiarity,  the  rules  may  be  worded  in  the  form  of  questions  which  are  to 
be  asked  as  each  system  state  is  described  and  as  each  transitional  PEF 
Unit  is  drawn  and  identified. 

Figure  9  will  be  used  as  a  general  model  of  any  single  PEF  Unit 
(e.  g.  ,  Function  or  element).  It  will  be  noted  that  y  is  the  output  state 
resulting  from  one  or  more  previous  PEF  Unit  transitions  and  z  is  all  or 
part  of  the  input  state  for  one  or  more  subsequent  PEF  Units,  As  a  result, 
rules  applied  to  y  ultimately  also  apply  to  z,  or  vice  versa.  Whether  to 
focus  on  y  or  on  z  will  depend  upon  whether  the  analyst  begins  GSSM 
construction  from  the  system  input  state  and  moves  forward  (operationally), 
or  whether  he  starts  at  the  system  output  state  and  works  toward  the  input 
state. 


y 

z 

(input  state) 

X 

(output  state) 

Figure  9.  A  PEF  Unit. 


Each  identifiable  state  of  the  system  suggests  a  multitude  of 
questions  leading  to  the  discovery  of  more  detailed  requirements.  As  the 
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analyst  acquires  more  and  more  information  regarding  system  requirements 
and  imposed  constraints,  a  larger  number  of  states  will  be  identifiable. 
Finally,  the  analyst's  perceptive  abilities  will  be  called  upon  to  discern  the 
many  ways  in  which  the  transition  can  be  made  from  one  state  to  the  next. 

If  the  system  already  exists,  a  primary  question  will  be, "la  the  activity  in 
the  procedures  manual  the  'inly  way  the  system  can  change  tu  the  next  state?" 
If  the  answer  is  "No, "  then  the  alternative  possibilities  may  impose  a 
threat  (or  greater  effectiveness)  to  achieving  the  system's  mission,  if  they 
are  discovered  by  an  experienced  operator.  If  the  system  is  being 
designed,  the  analyst's  knowledge  and  creative  talents  will  lead  him  to 
uncover  a  multitude  of  means  for  making  the  transitions  between  clearly 
defined  states. 

The  freedom  with  which  x  and  its  alternatives  can  be  identified, 
therefore,  will  depend  initially  upon  whether  or  not  the  analyzed  system 
already  exiBts.  Later,  it  will  be  seen  that  in  either  case,  x  need  not  be 
defined  at  all  until  one  or  more  methods  or  procedures  have  been  deter¬ 
mined  (or  designed)  for  making  the  transition  from  input  to  output  state. 

Note,  therefore,  that  the  first  several  questions  listed  below  imply  rules 
for  describing  system  states;  the  nature  of  x  should  not  impose  itself  on 
GSSM  construction  until  all  known  system  criteria  have  been  laid  down  in 
the  form  of  system  states.  The  most  effective  analyst  will  successfully 
ignore  existing  procedural  concepts  and  specify  only  system  requirements 
until  it  becomes  necessary  to  indicate  the  most  elemental  means  for  making 
transitions.  At  that  point,  the  procedurally  specified  operation  will  be 
exposed  as  (1)  the  only  reasonable  procedure,  (2)  inappropriate,  inadequate 
or  inefficient;  or  (3)  one  of  several  alternatives  of  which  the  system  is 
capable.  The  resulting  GSSM  will  reflect  the  discovery,  and  subsequent 
analysis  can  then  lead  to  allocation  of  standards  which  are  consistent  with 
the  real  model  of  the  system  -  -  not  affected  by  existing  procedures  which 
may  be  based  upon  desired  system  functioning. 

In  order  to  achieve  the  best  results,  therefore,  GSSM  construction 
should  be  undertaken  with  step-by-step  consideration  of  the  following  series 
of  questions;  the  answer  to  every  question  must  be  "Yes"  for  the  diagram  to 
be  complete  and  accurate. 

a.  Is  z  (or  y,  if  starting  at  output)  necessary  for  the  system 
to  meet  its  mission  objectives?  (If  not,  it  may  need  to 
be  re-evaluated  and  either  reworded  or  omitted.) 

b.  Is  z  (or  >  stated  as  completely  and  objectively  as 
possible  based  on  the  analysis  of  performance 
requirements?  (i.  e. ,  does  the  state  include  the 


specified  criteria  for  successful  accomplishment? 

States  must  be  worded  so  as  to  be  fully  described; 
all  relevant  features  must  be  included  as  observable 
or  measurable  system  conditions ,) * 

c.  Does  x  necessarily  follow  after  y?  Or,  does  y  necessarily 
occur  before  z?  (The  GSSM  must  show  the  Btates  in  the 
actual  relation  possible  between  one  another,  not 
necessarily  according  to  the  order  listed  in  a  procedures 
manual. ) 

d.  Does  z  describe  only  all  relevant  system  features  changed 
since  the  occurrence  of  y?  (z  should  be  complete  without 
excessive  additions.) 

e.  Does  y  describe  or  imply^  all  relevant  system  features 
changed  to  produce  z?  (The  input  state  to  a  PEF  Unit 
should  include  or  imply  the  system  conditions  which  are 
changed  by  the  PEF  Unit  activity.) 

After  all  possible  system  requirements  information  is  obtained 
and  y  and  z  are  described  in  terms  of  criteria  for  successful  system 
functioning,  then  define  one  or  more  activities  which  will  produce  the 
necessary  transition.  Each  activity  is  defined  as  x. 

f.  Is  y  completely  adequate  for  x  to  occur?  (If  additional 
input  conditions  are  needed,  those  must  be  included. ) 

g.  Is  y  just  sufficient?  That  is,  does  the  occurrence  of  x 
require  the  existence  of  the  entire  state  described  by  y? 

(If  not,  only  the  essential  features  should  appear.) 

h.  Does  the  diagram  illustrate  all  significant  occurrences  to 
which  y  may  give  rise?  In  other  words,  are  all  operations 
resulting  from  y  shown? 

i.  If  x  is  not  the  only  significant  operation  that  might  lie 
between  y  and  z,  for  this  particular  system,  are  the 
alternatives  also  included?  (If  not,  they  should  be.) 


A  state  specifies  a  required  system  condition;  it  is  not  a  statement  that 
an  activity  is  completed  or  that  a  condition  has  been  altered. 

The  input  state  to  any  PEF  Unit  includes  (1)  the  changes  resulting  from 
the  previous  transition  and  (2)  features  of  all  previous  states  which  have 
not  been  changed  during  the  just  preceding  PEF  Unit, 
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j.  Are  alternative  operations  significant  and  meaningful? 
(Alternative  activities  are  almost  always  possible* 
therefore,  H  is  necessary  to  include  only  those  which 
might  reasonably  be  expected  to  occur  sometimes  and  omit 
those  which  are  highly  unlikely  to  occur  at  all.) 

k.  Docs  z  fully  express  the  total  change  in  the  system  result¬ 
ing  from  x  and  only  x?  (All  relevant  features  of  the 
system  state  following  x,  and  to  which  x  has  contributed, 
should  be  included. ) 

l.  Is  z  complete;  that  is,  does  it  specify  the  alternative  out¬ 
comes  of  x?  (The  diagram  should  show  all  significant, 
possible  states  of  the  system  which  might  result  from  x.) 

Figure  10  illustrates  how  the  above  questions  lead  to  correct 
GSSM  construction. 


3.  Applying  the  Construction  Rules 

To  develop  an  elemental  GSSM,  one  proceeds  from  the  GSSM  for 
the  entire  system  (see  example  in  Figure  11).  The  first  major  con¬ 
struction  will  be  at  the  Function  level,  and  from  there  through  intermediate 
levels  --  if  necessary,  depending  primarily  upon  the  complexity  of  the 
system  --  down  to  the  most  detailed  elemental  level.  At  every  level  of 
GSSM  specificity,  however,  the  above  rules  should  be  applied  each  time 
a  rectangle  or  line  is  drawn. 

4#  Constructing  the  System  GSSM 

Step  1 

Draw  the  total  system  GSSM  as  a  single  rectangle  with  one  in¬ 
going  (left)  and  one  outgoing  (right)  line;  briefly  specify  the  overall 
system  operation;  or  system  title,  inside  the  rectangle. 

Step  Z 

On  the  right-hand  line,  describe  the  total  output  state  (i.e.,  the 
criteria  for  successful  mission  accomplishment),  and  indicate  system 
effectiveness  requirements. 


Step  3 

On  the  left-hand  line,  describe  the  input  state  of  the  system 
(i.e.,  the  state  necessary  for  the  system  to  initiate  its  mission).  The 
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CONSTRAINTS 


Temperature  =  T  ±T' 

.  Noise  level  s  N  ±  N' 
Illumination  level  =  I  ±  I* 

4.  Checkout  table  is  nonconductor 

5.  Operator  stands  on  rubber  mat 


INPUT  STATE 


OUTPUT  STATE 


1.  X  is  located  at 

2,  Checkout  gear,  Gj,  G2,  G3, 
and  G4  are  located  at 

Bench 
Checkout 
of  X 

1.  Measurements,  m,  meet 
criteria,  M,  within 
tolerance,  a;  i.e.,  ^ 

Lj,  L2,  L3  and  L4, 

respectively 

3.  Lx.  Li,  L2,  L3.  and  L4  are 
accessible  to  operator 

4.  Operator  is  ready  to  checkout 
X  and  has  appropriate  pro- 

m  j  3  M|  ±  a  j 
m2  3  M2  ±  a2 
m3  3  M3  ±  a 3 
etc. 

2.  X  is  located  at  Ly  (ready 
for  installation) 

cedural  instructions 


Figure  11.  GSSM  of  the  hypothetical  system. 
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accuracy  of  the  input  state  description  can  be  checked  as  more  detailed 
models  are  constructed,  since  every  change  in  the  state  of  the  eyBtem 
must  procede  from  a  prior  state  which  has  been  explicitly  described. 
TV  the  input  state  sets  the  complete  stage  for  all  subsequent  state 
changes . 


Step  4 

Above  the  rectangle,  list  all  constraints  placed  by  designers  on 
the  system's  operation. 


5.  Constructing  the  G5SM  at  the  Function  Level 

The  Function  GSSM  is  the  primary  basis  for  organizing  more 
detailed  models  and  is  essential  to  the  accurate  mapping  of  the  system 
in  greater  detail.  The  first  steps  in  its  construction  require  very  little 
additional  data  from  that  used  to  construct  the  System  GSSM;  however,  it 
requires  considerable  thought  and  understanding  of  the  system's  mission 
to  properly  describe  Functions  and  states  to  which  they  give  rise. 

Modeling  existing  systems  differs  somewhat  from  modeling  for 
design.  If  a  system  already  exists,  some  definite  assumptions  can  be 
made  regarding  constraints  on  equipment  and  manpower  available.  For 
design,  only  gross  descriptions  of  Function-determined  states  can  be 
made.  Also,  in  designing  a  new  system,  the  analyst  will  usually  begin 
with  the  output  state  of  the  system  and  develop  the  model  "backwards" 
toward  the  input  state  (which  will  often  not  be  entirely  specifiable  until 
the  design  is  completed).  Designed  systems  may  be  modeled  from  input 
state  to  output  state,  from  output  state  to  input  state,  or  from  both  ends 
toward  the  middle.  Therefore,  a  certain  amount  of  flexibility  is  possible 
in  applying  the  following  steps. 


Using  the  basic  construction  rule  questions  as  a  guide,  define 
the  major  system  states,  which  are  the  requirements  for  mission 
accomplishment;  describe  the  states  between  each  rectangle  compre¬ 
hensively,  but  without  being  too  specific;  that  is,  indicate  all  require¬ 
ments  but  without  including  any  precise  numerical  values.  If  desired, 
a  general  name  for  the  Function  may  be  written  inside  the  rectangle. 

Function  titles  are  relatively  unimportant,  as  long  as  they 
indicate  the  general  activity  involved  in  going  from  input  to  output  state. 
It  is  particularly  important  to  develop  the  habit  of  specifying  between- 
function  states  of  the  system  befr  :e  labelling  functions,  since  those 
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states  aid  in  defining  the  required  operation.  The  purpose  of  Step  5  is 
to  organize  the  modeling  procedure  rapidly  by  spending  minimal  time 
collecting  specific  data.  Care  should  be  taken,  however,  to  include  all 
important  functions  in  appropriate  relation  to  one  another.  The  result 
should  be  a  rough  but  accurate  model  which  could  apply  to  any  system 
having  the  same  mission.  (See  Figure  12.) 


Step  6 

Revise  between -function  states  to  include  all  specific,  measurable 
characteristics  that  are  obtainable.  (System  requirements  or  objective 
criteria  of  successful  performance.) 

Example 

Referring  to  the  sample  GMDF  of  II.  E,  the  GSSM  would  initially 
appear  as  shown  in  Figure  13,  with  system  states  clearly  defined,  h'jte 
that  the  functions  --  not  the  states  --  could  apply  to  the  checkout  of  any 
piece  of  electrically  powered  equipment. 

Assume  that  some  of  the  checkout  of  X  must  occur  before  power 
is  supplied  to  the  equipment;  some  of  the  checkout  can  occur  before  or 
after  power  is  supplied.  In  that  event,  Functions  B  and  C  are  not  clearly 
separable  as  indicated  in  Figure  13.  At  the  Function  level,  however, 

Figure  13  is  still  acceptable  because  it  is  primarily  descriptive;  a  more  specific 
diagram  would  no  longer  be  system  independent.  Thus,  a  second  break¬ 
down  may  be  performed  to  incorporate  the  new  information.  Figure  14 
illustrates  how  that  would  be  done. 


6.  Constructing  the  GSSM  at  Intermediate  Levels 


Figure  14  illustrates  a  form  of  intermediate  level  GSSM.  More 
commonly,  the  procedure  for  producing  intermediate  models  is  to  follow 
Steps  5  and  6  for  each  Function  separately.  However,  it  is  quite  possible 
to  find  that  some  functions  fall  readily  into  elements,  while  other  functions 
in  the  same  system  may  require  one  or  more  intermediate  level  models 
to  perceive  and  map  the  system  correctly. 


It  will  be  noted  that  the  final  output  state  of  the  intermediate  level 
GSSM  must  be  identical  to  the  output  state  of  the  corresponding  function. 
However,  it  should  be  remembered  that  part  of  the  GSSM  output  state 
includes  the  unchanged  states  occurring  anywhere  within  the  prior  portions 
of  the  GSSM. 
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7.  Constructing  the  GSSM  at  the  Element  Level 

The  procedures  for  constructing  models  at  the  element  and  inter- 
mediate  levels  are  identical  in  that  Steps  5  and  6  are  followed,  unless 
sufficient  immediate  knowledge  exiBts  to  apply  6  directly.  It  is  understood 
that  the  construction  rules  are  always  applied. 

Function  and  intermediate  level  models  provide  the  organization 
and  system  states  for  constructing  t, ■*.  GSSM  at  the  element  level.  Each 
PEF  Unit  in  the  most  recently  made  model  can  be  treated  as  if  it  were 
an  autonomous  operation.  That  is,  for  example,  if  all  states  have  been 
clearly  defined  between  Functions,  then  an  elemental  model  of  the 
states  within  each  Function  can  be  developed  to  take  the  system  from 
that  Function's  input  state  to  its  output  state,  and  that  can  be  done 
relatively  independently  from  the  diagramming  of  other  Functions.  By 
having  system  states  carefully  and  completely  specified,  it  will  always 
be  clear  exactly  what  portion  of  the  system's  operation  is  under  analysis. 

Referring  to  the  example  in  Figure  13,  the  GSSM  would  be  con¬ 
structed  as  shown  in  Figure  IS.  In  order  to  conserve  space,  note  that 
the  code  numbers  in  the  boxes  of  the  diagram  refer  to  the  "Activity 
Descriptions"  in  the  example  of  Figure  8. 


Figure  15.  GSSM  of  Function  B  in  example. 
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The  feature*  to  be  observed  in  the  examples  are  the  following: 

1)  The  output  states  of  B.  1,  B.Z,  B.3,  B.4,  B.5  and  L.  6  r..ay 
be  produced  in  any  sequential  order,  or  simultaneously  by  differe  it 
persons. 


Assume  that  the  GSSM  constructor  examines  that  data  and 
finds  no  clearly  specified  requirement  that  B.  9  depends  on  th  ;  simulta  sous 
existence  of  all  the  prior  states  (produced  by  B.  3  through  B.  8)  shown  in 
Figure  15,  even  though  the  procedures  specify  that  sequence;  as  a  result, 
he  consults  one  of  the  engineers  and  discovers  that  B.9  can  occur  when 
Vj  and  Vi  exist  at  the  outputs  of  PSj  and  PS^  respectively,  and  when  G4 
is  operative,  but  B.9  does  not  require  that  Gj,  Gg  and  G3  be  operative. 

The  GSSM  for  Function  B  would  then  be  revised  to  appear  as  shown  in 
Figure  16. 


Output  state 
of  Function  A 


&1 


PS  1  is  in 


B.£ 


warm-up 

condition 


PS 2  is  in 


PS  i  is  supplying 
Vl  *  vi  DC V  at 


its  output 


warm-up 

condition 


B.8t 


*R6 


is  operative 


PS2  is  supplying 

V4  *  v*  PCV  ajjkj— 1  X  18 

its  output  V  LcZJoperativel 


B.3 


Gj  is  operative 


*B.4 


G;>  is  operative 


*a5 


G3  is  operative 


Figure  16.  A  revision  of  Figure  15. 
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2)  The  system  requires  that  the  equipment  be  operative;  it 
does  not  require  simply  that  lamps  light.  Indicator  lamps  serve  as  feed* 
back  mechanisms,  but  their  illumination  does  not  in  itself  represent  the 
required  aspect  of  successful  system  performance. 


Even  though  the  system  can  become  operative  without  the 
operator's  perceiving  the  indicator  lamp,  simply  observing  an  indicator 
lamp  should  not  be  shown  in  the  model  as  an  alternative  procedure.  As 
a  general  rule,  the  GSSM  should  not  contain  any  set  of  alternative  PEF 
Units  which  only  differ  in  degree  of  feedback  information,  unless  the 
alternatives  can  be  found  in  the  LAMA  matrix.  However,  PEF  Units 
should  describe  the  entire  activity  of  which  the  system  ia  capable  to  make 
the  transformation  between  input  and  output  states,  (For  example,  use 
"Turn  POWER  switch  ON,  and  observe  POWER  ON  lamp  illuminates," 
if  that  is  a  means  of  producing  an  equipment-operative  condition;  do  not 
simply  indicate,  instead,  "Turn  POWER  switch  ON.") 

3)  Tube  type  power  supplies  will  generally  operate  if  the  DC 
voltage  is  turned  on  sooner  than  the  manufacturer  recommends,  but  the 
load  on  the  supply  may  be  excessive,  resulting  in  a  reduction  in  life 
expectancy  and  reliability.  However,  inoperativeness,  for  any  reason,  is 
a  maintenance  and  maintainability  problem  and  not  relevant  to  the  opera¬ 
tional  model  of  the  system.  If  the  supplies  function  without  warm-up,  the 
output  states  of  B.  1  and  B.  2  are  not  system  requirements  (that  is,  the  three 
minute  wait  is  not  essential  to  successful  system  performance)  and  those 
PEF  Units  should  not  appear  in  the  GSSM.  On  the  other  hand,  if  the 
supplies  will  not  operate  without  the  delay,  and  if  there  is  a  constraint  not 
to  use  a  time  delay  relay,  a  nsw  PEF  Unit,  "Wait  at  least  three 
minutes"  will  need  to  be  inserted  between  the  following  states;  "PS  is  in 
warm-up  process;  DC  is  inaccessible"  and  "PS  is  in  warm-up  condition; 

DC  is  accessible." 
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4)  It  is  assumed  in  Figure  15  that  X  cannot  be  turned  ON  unless 
the  output  states  of  B.  3  through  B.  8  all  exist.  However,  investigation 
may  prove  that  X  may  be  turned  on  at  any  time;  if  that  were  true,  it 
should  be  noted  that  the  input  state  for  B.  9  would  be  identical  to  the  input 
state  for  B.  1  through  B.  6. 


G.  Special  Constructions 

1.  Transition-Equivalent  Alternatives 

Figure  17  indicates  that  two  entirely  different  operations  are 
possible  to  make  the  transition  from  the  input  to  the  required  output  state; 
however,  it  is  understood  that  each  operation  may  be  associated  with  a 
different  probability  of  arriving  at  that  state. 
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Radar  operator 
sees  scope  blip 


Align  range  and 
bearing  cursors 
with  x  and  read 
counters 


representing 
target  x 


■*$ 


Estimates  of  range 
and  bearing  of 


r  i 

Estimate  range 
and  bearing  of 
x  on  scope 

target  x  are  known 
Hy  the  radar  operator 


Figure  17.  Example  of  transition-equivalent  alternatives. 


Figure  17  is  an  example  of  transition-equivalent  alternatives; 
one  and  only  one  of  two  or  more  procedures  can  occur  to  make  the  system 
required  transition  from  the  given  input  state  to  the  common  required 
output  state.  If  the  system  inherently  makes  it  possible  to  achieve  the 
transition  in  more  than  one  way,  all  reasonable  alternatives  must  be 
included  in  the  GSSM.  Such  alternatives  may  be  contingent  on  arbitrary 
choices  available  to  an  operator  as  the  result  of  inherent  system  capability. 
That  is,  the  operator  may  perceive  several  ways  to  accomplish  a  task  or 
the  system  may  allow  for  different  approaches  under  various  assumptions 
regarding  conditions  under  which  operation  proceeds. 

2.  System  Required  Alternatives 

Figure  18  show's  an  example  of  alternatives  which  depend  on 
the  (unpredictable)  nature  of  the  input  state. 

The  example  assumes  that  all  classified  messages  received  by 
teletype  are  to  be  transmitted  to  a  post  commander  by  courier  and  all 
unclassified  messages  are  to  be  transmitted  by  telephone  (due  to  require¬ 
ments  for  safety  an.,  economy,  respectively).  At  any  given  time,  however, 
it  cannot  be  predicted  which  type  of  message  will  be  received  by  the 
operator  for  transmission.  The  alternatives  arising  from  the  different 
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possible  input  states  are  called  "system  required"  because  the  system  has 
different  constraints  imposed  on  it  for  each  possible  input  state. 


Message  x  is 
unclassified 


Teletype  operator 
has  message  x  ^ 


message  x 
is  classi¬ 
fied 


Transmit 
message  x  to 
commander  by 
telephone 


Transmit 
message  x  to 
commander 
via  courier 


Commander 

-T - > 

has  posses¬ 
sion  of 
message 


Commander 

reads 

message 


Commander 
has  informa¬ 
tion  upon 

which  to  ^ 
base  a  decision 
regarding 
"Operation  Y" 


Figure  18.  Example  of  system-required  alternatives  leading  to 
a  common  output  state. 


Backur 


>erations 


Complex  systems  may  include  requirements  which  can  only  be 
met  by  performing  a  set  of  activities  more  than  once.  For  example,  (1) 
an  individual  may  be  required  to  perform  the  same  set  repeatedly  so  as 
to  satisfy  stringent  criteria  in  the  output  state,  or  (2)  two  or  more 
individuals  may  perform  the  same  activity  either  independently  or  in 
conjunction  with  each  other,  so  that  the  final  output  state  is  a  function 
of  their  joint  efforts. 
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'A  n«*U  *  »>•■■»( rm  require  ■  a  vet  ,\s  ti-  ifies  q,  br-  repealed  one 
<.it  ni'v re  timcf.,  the  output  state  e a n  in"  expci  ted  i>>  luvi'  a  higher  probability 
of  occurring  correctly  than  ii  the  a«*r  w»ti?  |>«*rf»irm»’d  only  tinef.  (Such 
repetition  w-dl  a  bo  result  in  higher  allocated  probabilities  to  PEF  Units 
within  a  cycle.)  Figure  19  show*  an  example  of  a  cyclical  repetition  in  a 
simple  checkout  operation  of  a  power  supply. 
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1.  Calibration 


Press  and 

has  been 

Di 

hold  switch 

DZ 

performed 

reads 

S^,  rotate 

reads  _ 

twice 

X  *  x' 

knob  & 

v±?9 
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read  dial 
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supply  is 

t>2 

i 

capable  of 

i 

accurate 

i 

readout 

Calibration  has 
been  performed  once 
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Figure  19.  Example  of  a  calibration  procedure  on  a  power  supply. 


When  operating  procedures  (or  design  criteria)  specify  this 
type  of  repetition,  the  GSSM  should  include  a  dashed  line  which  indie  ce.s 
exactly  which  state  is  assumed  still  to  exist  and,  therefore,  which 
activities  are  to  be  repeated.  The  dashed  line  chciuld  be  identified  by 
conditions  (system  state)  which  lead  to  r -petition,  and  the  undashed  output 
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Figure  ?  shows  a  by putlu'tn. al  radar  system  in  wh«ch  the 
radar  operator,  plotter  arid  watch  officer  are  periodically  exchanging 
target  information,  unlike  lire  system  described  in  Figure  19,  repetition 
in  this  system  will  usually  result  in  additional  information  {e.g.,  direc¬ 
tion  and  velocity  of  target)  rather  than  increasing  the  accuracy  of  the 
same  information.  Thus,  the  output  state  "Watch  officer  has  sufficient 
data  to  make  judgment  about  target's  identity"  may  importantly  depend 
cm  the  number  of  such  repetitions.  Whether  or  not  that  is  the  case,  how¬ 
ever,  may  depend  on  the  particular  system  and  operating  procedures 
which  are  assumed  to  be  used.  If  the  target  is  a  high- speed  nuclear 
missile,  for  example,  it  may  be  less  appropriate  to  wait  for  additional 
information;  in  effect,  the  system  which  includes  defense  measures  may 
have  a  lower  probability  of  being  accomplished.  The  analyst  must  there¬ 
fore  structure  the  GSSM  according  to  the  unique  characteristics  and 
requirements  of  a  given  system.  Like  Figure  19,  the  repetition  cycle  in 
Figure  3  is  denoted  by  a  dashed  line. 

b.  Concurrent  Duplication 

Figure  20  represents  the  portion  of  a  system  in  which  two  or 
more  independent  but  identical  sets  of  activities  are  performed  simul¬ 
taneously  in  order  to  satisfy  a  very  high  SER.  Tlx  probability  that  the 
system  successfully  achieves  its  mission  is  expected  to  increase  with  the 
number  of  duplications;  therefore,  this  special  situation  must  be  repre¬ 
sented  in  the  GSSM.  Figure  20  illustrates  how  concurrent  duplications 
are  indicated  in  the  GSSM;  a  line  is  drawn  paralleling  the  activity  or 
activities  which  are  duplicated.  The  line  is  interrupted  by  a  circle  within 
which  is  a  number  corresponding  to  the  minimum  number  of  concurrent 
duplications  required  by  the  system.  Thus,  Figure  20b  has  the  same 
interpretation  as  Figure  20a. 

c .  Redundancies 

When  concurrent  operations  provide  backup  to  aid  the  accuracy 
of  a  ^rtivitv  ♦‘hroue''  "•dhac.k,  the  ,-,c.id  *T  »-  - - 

dunaw..  ■'  Figure  21  illustrates  a  hypothetical,  redundant  set  of  condi¬ 
tions  in  which  the  system  state  resulting  from  activities  A  and  B  are 
checked  for  accuracy  in  C,  D  and  E;  the  latter  provide  feedbe. '  to  increase 
the  likelihood  of  the  rorrect  accomplishment  of  A  and  B.  F;  2  21  also 
indicates  the  very  likely  alternative  condition  that  the  system  allows  for 
A  and  B  to  be  performed  without  feedback  from  C,  D  and  E. 
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Figure  20,  Schematic  representation  of  concurrent  duplications 
(with  cyclical  repetition). 


SO  - 


Figure  21,  Example  of  a  redundancy. 


H.  Some  Additional  Construction  Rules 

1.  Transition-equivalent  alternative  activities  or  activity  sequences 
should  begin  at  the  common  input  state  and  end  at  the  common  output  state, 
even  if  elements  must  be  repeated.  For  example,  assume  the  system 
"going  home  from  the  airport"  defined  as  shown  in  Figure  22. 


Figure  22.  Another  hypothetical  system. 

X  may  take  a  bus  (B)  or  hail  a  taxi  (T).  If  X  takes  a  bus,  he  may  walk 
home  from  the  bus  stop  (W)  or  take  a  Taxi  (Tjj).  If  X  chooses  to  take  a 
taxi  from  the  bus  stop,  he  may  be  able  to  find  one  locally  available  (F) 
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information  as  the  correct  version). 


(a) 


(b) 


Figure  23, 


Example  of  establishing  a  single  set  of  transition- equivalent 
alternatives . 


Note:  Other  alternatives  are  conceivable,  but  based  upon  one's  knowledge 
of  the  system,  they  arc  not  meaningful.  For  an  absurd  example,  X  might 
conceivably  find  a  pair  ol  skates  and  skate  home.  For  a  more  sane  exam¬ 
ple,  X  could  have  driven  a  car  to  the  bus  stop  and  left  it  there  until  his 
return.  However,  based  on  our  knowledge  of  X  (or  lack  of  parking  spaces 
near  the  bus  stop)  th»  probability  is  almost  zero  that  he  would  use  that 
strategy:  perhaps  X  has  never  owned  a  car,  he  ia  too  young  to  drive,  or 
his  wife  always  uses  the  car. 
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L,  Whore  transition-equivalent  ultc  rnativu  urti  itics  are  nut  exclusive 
establish  diagrammatic  combinations  which  force  them  to  he  exclusive, 

For  example.,  assume  that  X  told  his  wile  (C\y)  that  he  might  call 
her  when  he  arrived  at  the  airport  and  that  he  might  either  call  a  taxi 
,(C|)  to  take  him  home  or  ask  her  to  pick,  him  up,  depending  on  his  feelings 
at  the  moment.  Thus,  X  may  call  for  a  taxi  nr  >-a U  his  wife  or  both,  as 
shown  in  Figure  24. 


CORRECT 


INCORRECT 


The  correct  procedure  is  to  Do  not  try  to  improvise 

establish  exclusive  alternatives,  an  ''and/or1'  symbol. 

This  enables  independent 
analysis  of  all  possibilities. 


Figure  24,  Example  of  establishing  mutually  exclusive  alternatives. 


3.  Where  alternative  activities  depend  upon  other  contingencies, 
those  contingencies  are  summated  with  the  existing  state  of  the  system. 
To  illustrate,  consider  the  example  under  1  above;  assume  that  if  a  taxi 
is  available  (T1)  when  X  gets  off  the  bus,  he  will  take  it,  otherwise  he 
will  walk.  This  situation  is  diagrammed  in  Figures  25a  and  25b,  which 
are  equivalent  alternatives. 
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i  ax  i  i  * 


available 


(a) 


T axi  is 


(b) 


Figure  E5.  Example  illustrating  inclusion  of  contingencies. 


4.  Always  avoid  repeating  what  is  already  implicit.* 

Example  1 

Assume  an  operator  h-s  three  checKout  switches  to  operate.  SI 
turns  on  one  light,  LI,  and  Sit  turn  .  on  L2.  Subsequently ,  So  turn-,  off  L2 
and  li’tituo  LI  ui'  *•'  ■  -.strates  tne  correct  GSSM. 


The  example  which  was  carried  through  the  previous  three  rules  cannot 
readily  be  used  to  illustrate  this  rule.  Thus,  it  is  to  be  noted  that  every 
rule  may  not  be  applicable  to  all  systems;  every  system  must  be 
approached  uniquely. 
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(Conditions  for 

J 

(Sy  ntrm) 

|  1.1  i ;;  on 

_ 

l.  _  ■  1.  -  .  .  J  \ 

v  net.MJut/ 

Checkout 

1  J  J  ;  .-.If 

(a) 


CORRECT 


INCORRECT 


The  correct  diagram  give  a 
all  necessary  information, 


Do  not  indicate  a  state  that  is 
already  specified  by  the  diagram. 


LI  is  on 


(b) 


(c) 


Figure  2*>.  Example  illu- '  i-ituig  an  implicit  state. 


^Parenthetical  information  is  understood  from  a  previous  state  and 
would  normally  not  be  repeated. 
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A. 


nr.  gqn  strug  ting  niE  ma  :tu;:ma  i'icai, 
st.vi  v)  '<Kut*r-:r-if?K  model 


Introduction 


Thu  MSSM  u ar.e i'it i .1 1  i  v  consists  of  an  equation  •which  expresses 
the  relation  Iv-twecn  tne  r«*<|'ti  red  »»f  ribabilitv  of  .» t  hievlrii;  the  system 
output  st  a  to  Stilt  the  probabilities  (to  b<3  derived!  ol  ja  ompHshim.?  the 
PF3F  Units  which  the  syntriji  comprises .  Although  the  MSSM  involves 
relation*  snionp  probability  ‘"’luc:;,  ii  i.oiiiains  all  information  necessary 
for  allocating  pe rio rm.uu  r  ti sties  ,13  well  as  probabilities  of  Accomplish¬ 
ment,  it  time  is  also  included  as  a  system  effect ivenv.A»  ffeapii rement. 

The  purpose  of  the  MSSM  is  to  ortuhlr  the  mathematical  derivation  of 
performance  .'itnndarrtu  from  the  SKR. 

The  MtiSM  is  a  relatively  simple  translation  of  the  GSSM;  since 
the  graphic  model  is  in  the  form  of  a  logic -flow  diagram,  successive 
states  can  be  conceived  as  being  probabilistically  related  to  one  another, 
For  that  reason,  the  MSSM  can  be  no  more  accurate  than  the  GSSM 
from  which  it  is  directly  derived. 

If  TEPPS  computer  propram  is  to  be  employed,  it  will  generally 
be  unnecessary  to  construct  an  MSSM,  since  the  computer  operates 
upon  symbolic  data  which,  directly  describes  the  GSSM.  Thus,  the 
computer  implicitly  constructs  the  MSSM  in  the  process  of  operating 
on  those  data.  Nevertheless,  it  is  important  to  understand  the  structure 
of  the  MSSM  in  order  to  (1)  symbnHr.c  the  GSSM  correctly,  (£)  arrange 
the  data  for  impropriate  computer  analysis,  and  (A)  interpret  the  results 
of  the  analysis.  In  particular,  in  order  to  urn  the  computer,  it  will  be 
essential  to  understand  Steps  1  and  L  in  the  Procedure  part  it  this 
section  Instructions  for  constructing  the  mathematical  model  will 
be  presented  below.  Examples  will  be  used  to  illustrate  each  step  in 
the  procedure,  The  few  symbols  listed  in  Table  II  are  the  MSSM  tools 
and  cornponents  which  unable  translation  from  the  GSSM. 
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Tabic  II 


MSSM  Symbols 


Symbol 

Meaning 

Exarr.pl  e 

*  V  x  ) 

The  probability  of  Vi'hflt* 

*  the  probability  of  the 

or 

ever  is  contained  in  the 

required  output  state  of  element 

parentheses . 

3  of  Function  B,  (It  is  assumed 
that  the  input  state  to  B.  3  initiated 
that  elemental  personnel/equip¬ 
ment  function. } 

n 

The  product  of  the  n  values 

Assuming  the  system  has  four 

n 

following  the  symbol. 

Functions,  as  shown  in  Figure 

i=i 

13, 

4  D 

n  P(i)=  n  P(i)  =  P(A)P(B)  P(C)  P(D) 
i=l  i=A 

That  is,  the  symbol  says  "multiply" 
the  four  probabilities,"  substituting 
for  i  all  letters  from  A  to  D. 

m 

The  sum  of  the  m  values 

m 

Z 

j=l 

following  the  symbol. 

^  VX1  +  X*  +  X3  +  X4  +  X5 

Just  as  for  the  product  symbol, 
the  summation  symbol  says, 
"substitute  for  j  all  whole  numbers 
from  1  to  m. " 
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B. 


Basic  Principles 


All  Mathematical  State  Sequence  Models  are  expressions 
relating  the  probability  of  an  output  state  to  the  probabilities  of 
accomplishing  the  PEF  Units  giving  rise  to  that  output  state.  Since 
TEPPS  is  concerned  with  the  probability  of  success  for  each  system 
ope  ration -- rather  than  for  an  average  of  many  opc  ration  s -- only  one 
rule  applies  each  time: 

Rule  1:  The  probability  of  the  output  state  of  a  required 

set  of  PEF  Units  is  related  to  the  product  uf  the 
probabilities  associated  with  those  PEF  Units, 


The  mathematical  expression  of  this  rule  is: 

n 

Pq  »  P  (in)  n  P(i) 

i=l 

where  PQ  is  the  probability  of  the  output  state,  P(in)  is  the  probability 
of  the  input  state,  and  i  represents  the  code  numbers  assigned  to 
the  component  PEF  Units.  An  example  of  the  application  of  Rule  1 
is  shown  in  Figure  27. 


P(Z)  =  P(X)  P(A)  P(B)  P(C)  P(D)  P(E) 
E 

p(Z)  =  P(x)  n  P(i) 

i=A 


Figure  27.  Application  of  MSSM  Rule  1. 
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Because  there  often  are.  alternative  sets  of  PEF  Units  and  output  states, 
there  may  exist  many  mutually  exclusive  paths  by  which,  to  arrive  at 
the  system  output  state  from  a  given  input  state,  Moreover,  the 
different  alternatives  within  a  set  are  likely  to  be  associated  with 
different  probabilities.  Thus,  for  every  possible  path  in  the  GSSM 
th-.re  is  a  corresponding  and  identical  equatiun  tliat  only  differs  from 
the  others  in  that  a  different  set  of  probabilities  are  used. 


Since  only  one  alternative  can  be  selected  for  any  one  system 
operation,  each  alternative  in  a  set  must  contribute  to  satisfying  the 
SER .  To  symboli/.e  independence  (or  mutually  exclusive  charaeter- 
istice)  of  alternative  PEF  Units,  Rule  2  is  used, 

Rule  2;  The  probability  of  the  common  output  state  of  an 
alternative  set  of  PEF  Units  is  symbolized  as  the 
bracketed  matrix  of  the  probabilities  associated 
with  those  PEF  Unit3. 


The  second  rule  applies  wherever  the  GSSM  has  a  circle  with  a 
cross  or  triangle.  The  "common  output"  state  exists  where  a 
circle  with  a  cross  has  two  or  more  arrows  entering  it  from  alterna¬ 
tive  operations  which  lead  to  that  state.  The  general  mathematical 
expression  for  that  arrangement  is: 

m 

P  (common  output)  =  P(in)  [P.  ]. 

J  J  —  t 

where  P(in)  is  the  probability  of  the  common  input  state  for  the 
alternative  set  implied  by  the  GSSM  line  leading  into  the  circle  with 
a  cross  or  triangle,  and  j  represents  one  of  the  alternatives.  Simple 
examples  of  the  application  of  Rule  2  are  shown  in  Figure  28. 

It  may  be  noted  that  a  set  of  alternatives  may  involve  several 
PEF  Units  which  taken  together  must  be  symbolized  as  a  product 
(see  Figure  28b).  It  is  of  particular  importance  to  note  that  alterna¬ 
tives  represented  by  circles  with  crosses  have  probabilities  enclosed 
within  square  brackets,  in  the  MSSM,  while  alternatives  designated 
by  circles  with  triangles  have  probabilities  within  parentheses. 
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P(Z) 


(P{A)  P{B) 

P{C) 

P(D)  P(E)  P(F) 


(a) 


(b) 


Figure  28.  Applications  of  MSSM  Rule  2. 


While  the  MSSMs  for  the  twc  kinds  of  alternative  sets  appear 
similar,  they  represent  quite  different  functional  situations.  In 
Figure  28b,  for  example,  the  input  state,  X,  may  take  one  of  three 
distinguishable  forms,  while  in  Figure  28a,  X  is  the  necessary  and 
sufficient  condition  for  A,  B,  or  C  to  occur.  Similarly,  states 
zj,  Z2>  and  are  equally  acceptable  output  states  in  Figure  28b, 
but  they  are  not  identical;  in  Figure  28a,  however,  all  three  PEF 
Units  produce  the  common  output  state  Z.  An  understanding  of 
these  differences  between  the  two  types  of  alternatives  will  be 
critical  to  accurately  preparing  the  data  for  the  computer. 
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c. 


Procedure 


Generally  speaking,  it  will  be  necessary  to  write  a  separate  set 
of  equations  for  each  discernible  segment  of  the  GSSM,  since  most 
models  will  be  quite  complex..  To  aid  in  construction,  and  to  provide 
the  coding  necessary  to  use  the  TEPPS  computerized  program  for 
deriving  standards,  it  is  necessary  to  assign  dummy  reference  symbols 
to  certain  states  of  the  system. 

Step  1 

Construct  a  skeletal  GSSM  from  the  one  being  analyzed.  The 
skeletal  model  is  a  reduced  model,  identical  to  the  original  but  with  no 
verbalizations;  only  lines,  logic  symbols,  and  rectangles  containing 
identification  numbers  are  treed.  An  example  is  illustrated  in  Figure  29. 

Step  2 

Assign  an  identification  number  to  each  PEF  Unit  according  to 
the  following  rules: 

a.  Assign  a  digit  --  starting  with  1  --  successively  to  each  "Sett" 

of  PEF  Units.  A  Set  is  defined  as  (1)  a  GSSM  element  which  is  not 
a  member  of  any  alternative  group  (UnitSet),  or  (?)  more  than  one 
(Compound  Set)  which  contains  elements  in  a  chain,  bounded  by 
circles  with  either  a  cross  or  triangle.  Branches  from  a  dot 
(ultimately  entering  an  open  circle)  are  treate  d  the  same  as  if 
they  were  along  a  single,  continuous  line.  Thus,  in  Figure  29, 
PEF  Units  1,  3,  4,  5,  7,  9,  10,  and  11  are  all  Unit  Sets.  The 
remaining  GSSM  elements  are  members  of  one  of  the  three 
Compound  Seta. 

b.  Assign  a  second  digit  --  sta  'ing  with  1  --  to  every  element  within 
each  Compound  Set.  (.4  Unit  Set  is  always  represented  by  only 
one  digit.)  For  example,  in  Figure  29,  there  are  only  two 
members  in  the  Compound  Sets  whose  first  digits  are  6  and  8. 

c.  Assign  a  third  digit --starting  with  1  --  to  every  element  in  a 
series  lying  within  a  Compound  Set  In  Figure  29,  the  second 
group  in  Set  #2  has  three  series  elements.  (In  the  diagram,  PEF 
Units  joined  by  a  dot  and  open  circle  are  treated  the  same  as  if 
they  were  strung  in  a  sequential  chain.  ) 

d.  Continue  adding  extra  digits  for  Compound  Sets  within  Compound 
Sets.  The  principle  is  this:  odd  digits  represent  sequential 
position,  and  even  digits  represent  parallel  (alternative)  GSSM 
position.  An  example  *  '  a  more  complex  arrangement  is  shown 
in  Figure  30,  which  is  ,  esented  simply  to  illustrate  another 
application  of  these  procedures. 
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hypothetical  arrangement  of  PEF  Units 


Step  Z  (Cont'd.) 


v  An  example 

Referring  to  the  MSSM  in  Figure  29,  first  digits  would  be 
assigned  as  follows: 

1  (  2  )  3  4  5  (  6]  7  (8)91011 

Observe  that  every  number  within  first  level  parentheses  or 
brackets  has  the  same  first  digit.  Second  digits  --referring  to 
parallel  groupings  --would  only  be  assigned  to  2,  6,  and  8, 
a  s  follows : 

1  (2.  1;  2. 2;  2.3)  345  (  6.1;  6.2]  7  (8.1;  8.  2  ]  9  10  11 


Third  digits  -  -referring  to  a  series  within  an  alternative  group  -  - 
are  assignable  only  to  the  second  set,  as  follows; 

1  (2.1;  2,2.1,  2.2.2,  2.2.  3;  2.3  1,  2.  3.  2  )  3  4  5  [  6. 1;  6.  2  ] 
7  (  8.1 ;  8.  2]  9  10  1 1 


Double  check:  that  there  are  as  many  identification  numbers  as 
PEF  Units  in  the  GSSM.  Another  double  check  is  to  place  numbers 
having  different  digits  in  the  second  place  in  brackets  and  compare 
the  pattern  against  the  MSSM.  For  example: 


2.  1 

1  (  2.2.1;  2.2.2;  2.2.3)  3  4  5 

2.  3.1;  2.  3.  2 


■  (t:] 


9  10  11 


(Other  examples  arc  presented  in  the  section  on  Allocation. ) 
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* 


Step  1 


If  the  OSSM  is  large  and  rotnplrx,  and  if  an  immediate  attempt 
is  made  to  relate  the  probability  of  the  output  to  that  of  the  input, 
errors  in  constructing  the  MSSM  are  likely  to  occur.  To  minimize 
sv’.eb.  errors,  divide  the  GSJsM  into  manageable  g roups  of  PUF  Unity , 
and  assign  dummy  reference  letters  to  the  states  between  groups. 
Then,  starting  at  the  beginning  of  the  GSSM.  write  the  series  of 
equations  relating  the  output  of  each  group  to  its  input  state  by 
applying  the  two  rules  appropriately. 


Step  4 


After  the  entire  series  of  equations  is  written  for  the  system, 
start  with  the  last  equation  and  perform  the  following  operation  repeat¬ 
edly  until  "o  dummy  ’■eft* rente  tetter®  appear  in  the  equation  relating 
P(out)  to  P(in),  always  keeping  P(out)  on  the  left  side  of  the  equation. 
That  is  done  by  substituting  for  each  reference  letter  probability  it3 
equivalent  value,  as  determined  in  a  prior  equation. 

The  equations  accompanying  the  GSSM  in  Figure  29  illustrate 
the  application  of  the  steps  listed  in  the  prec  eding  section. 
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IV. 


ALLOCATION 


A,  Introduction 


A  primary  goal  of  TEPPS  is  to  provide  a  means  of  allocating  system 
rflec' ivencss  requirements  among  discernible  system  operations  *  and 
thereby  establish  performance  standards  i>r  those  operations.  This 
Section  is  concerned  with  the  procedure  for  deriving  probability  and  time 
standards  for  identified  personnel/equipment  functional  units  of  a  system. 
The  derived  standards  will  thus  represent  a  Set  '1  ’-equirements  on  each 
PE  F  Unit  such  that  the  overall  SER  can  be  met. 

Allocated  standards  differ  conceptually  from  capability  data;  care 
should  always  be  taken  to  keep  in  mind  the  distinction  between  them  if 
accurate  interpretations  and  conclusions  are  to  be  made  from  the  outcome 
of  the  allocation  process.  There  exist  very  few  reliable  human  capability 
data  involving  either  probability  alone  or  probability  and  time  to  perform 
a  given  activity.  If  they  were  available,  such  data  would  have  been 
determined  experimentally  by  having  observed  many  persons  performing 
the  same  act  many  times  and  recording  accomplishment  times.  The 
results  would  be  a  probability  density  function  (over  time)  with  known 
mean  and  standard  deviation. 

The  process  of  allocating  standards  does  not  require  human  capability 
data  nor  does  it  imply  man's  capability  to  meet  those  standards;  rather, 
the  process  establishes  performance  levels  which  must  be  reached  for  the 
associated  SER  to  be  met.  To  derive  those  standards,  TEPPS  utilize 
activity  indices  which  are  estimated  to  reflect  the  relative  probability  of 
accomplishing  the  various  acts.  By  U3ing  many  judges'  estimates,  density 
functions  of  indices  over  time  have  been  generated  so  as  to  be  able  to 
specify  the  most  reasonable  requirements  on  PEF  Unit  accomplishment. 

The  computational  process  by  which  standards  are  derived  from  the 
indices  would  be  tedious  and  error  prone  if  done  manually.  Therefore, 
it  is  assumed  that  the  analyst  will  be  able  to  use  a  computer  and  the 
TEPPS  program  to  accomplish  the  goals  of  allocation.  However,  in 
order  to  establish  the  most  accurate  interpretation  of  results,  the 


It  should  be  kept  in  mind  that  operations  (i.e.,  PEF  Units)  are  derived 
from  analyses  of  system  states.  A  PEF  Unit  or  set  of  alternative  PEF 
Units,  is  defined  by  its  input  and  output  states.  Thus,  allocation  may  be 
viewed  as  the  process  of  determining  elemental  system  states  and 
deriving  probability  and  time  standards  for  achieving  those  states. 
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procedure*  Wluvi  will  explain  briefly  some  of  the  computer  operation* 
for  utilizing  input  data  te>  derive  s  tandar  Is  With  this  information  and 
a  calculator ,  an  analyst  can  allocate  to  a  limited  number  of  PKF  Units, 
if  a  computer  were  nut  available  and  if  Mir  S K U  included  iv  time 
component. 


B .  Procedures 

The  data  used  for  allocation  are: 

•  Overall  SER  components:  probability.  P  ,  and,  when 
applicable,  time,  T  .  Also,  any  effectiveness  require¬ 
ments  specified  for  any  lesser  portion(s)  of  the  system, 

•  The  GSSM,  used  for  (1)  the  description  of  activities, 
and  (?)  deciding  Upon  the  mode  of  analyzing  alternatives. 

•  The  MSSM,  which  can  aid  in  establishing  the  type  and 
number  of  entries  to  i:<  into  the  computer. 

•  I'.Ma  Store  entries  Tor  !  (the  index  of  task  ;u  complish- 
nui'U,  ln,jn  and  l|))i)Si  for  rail',  activity  shown  in  the 
tihSM.  (See  iteo  s  t  and  I  on  page  14.  1 

Step  .1 

Observe  who  the  r  the  SLR  specifics  a  time  component  (T1,). 

If  it  does,  go  to  Step  2;  if  not,  omit  Steps  1  through  3,  and 
start  with  Step  4  omitting  references  to  time. 

Step  2 

Examine  the  GSSM  closely  and  estimate  T  .  the  sum  of  the 
times  required  for  interim  activities  (if  any)  not  indicated  on  the  GSSM. 
For  example,  T  >  would  include  (1)  time  to  walk  from  one  console  to 
another.  (2)  timoB  to  interact  with  other  personnel  or  equipment 
because  of  the  unique  nature  of  the  specific  system  context,  where 
time  data  for  the  ac*'vities  are  not  available,  and  (3)  in  general, 
times  for  a  man  to  make  whatever  movements  may  he  required  in 
the  real-life  situation  to  initiate  a  PF,F  Unit  activity  after  the 
occurrence  of  its  input  state,  as  specified  in  the  GSSM. 


-  68  - 


Petr  rminr  I,,  from  the  following  relation 


\  1  I  1  1 

f>  <t  *’ 

whi'ri.'  T  '  is  tin-  Stilt**  specif  ierl  time  value,  and  f  ,  if*  the  estimate 
marie  in  Step  1 . 


Step  4 


Gather  all  remaining  data  til  efferti  vr  nes  «  rcquii  emeiil s , 
ii!)  PLcF  Unit  GSSM  -  representation  numbets.  (M  associated  PKF 
Unit  identification  nu  nliers  frmn  the  Ihitu  Store,  anti  (41  l>.it<i  Store 
information,  i.e,  ,  index  and  time  values. 


Step  5 

Punch  all  necessary  data  c  ards  acc  ording  to  the  formats  pre¬ 
sented  in  Section  V, 


1  o  reduce'  computer  operating  tinie,  and  to  simplify  evaluation 
of  allocated  standards,  select  only  one  or  two  of  the  alternatives  of 
greatest  interest  from  among  each  set  of  alternative  paths  designated 
by  an  input  c.i relo-wilh- cross  (or  left  parenthesis  in  th<’  MSSM),  in 
other  words,  lay  aside  the  oirds  holding  identification  numbers  of 
tran  ition  equivalent  alternatives  not  to  In-  included  in  the  first  run, 

.ML'-'IG7. 

Arrange  data  cards  according  to  the  format  described  in 
Section  V , 


Step  8 

Feed  data  and  program  to  compute* r, 


Step  ') 

If  it  is  desired  to  examine  allocations  based  on  other  parenthetical 
alternatives  (input  circle- with- cross),  insert  the  cards  in  the  appropriate 
location  in  the  original  deck  and  remove  other  previously  examined 
members  of  the  same  alternative  jet.  A  general  description  of  the 
computer  operations  >.n  included  in  Appendix  A, 
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C p rnp.uter  Operations  and  An  Example 

In  order  to  demons trate  application  of  the  procedures  and  how 
the  computer  operates  on  the  data,  reference  will  be  made  to  the 
relatively  simple  skeletal  GSSM  shown  in  Figure  31. 

Note  that  identification  numbers  are  shown  as  subscripts  of  the 
indices  (1),  minimum  times  (T^,  and  maximum  times  (T^),  from 
the  Data  Sturm  The  same  subscripts  are  also  used  to  Ulentify 
the  probability  (p)  and  time  (t)  stan  lards  which  are  to  be  allocated, 

In  Figure  31,  it  may  be  noted  that  (1)  a  single  digit  in  the  subscript 
is  used  when  the  PEF  Unit  is  not  part  of  an  alternative  set,  and 
(2)  within  an  alternative  set,  the  first  digit  represents  the  number 
designated  to  the  entire  set,  the  second  digit  represents  the  "route" 
number  within  an  alternative  set,  and  the  third  digit  represents  the 
order  within  a  particular  "rout",  " 

Assume  that  the  analyst  is  primarily  interested  in  the  alterna¬ 
tive  routes  designated  by  3.  1  and  3.2.  1,  3.  2.  2,  so  that  examination 
of  the  other  two  alternatives  is  temporarily  postponed.  (If  all  three 
alternatives  are  included  in  the  analysis,  allocation  throughout  the 
system  will  be  based  on  the  most  demanding  one  —  i.  e.  ,  the  one 
with  the  lowest  index  of  accomplishment.  )  The  MSSM  thus  reduces 
to  the  following: 


where  each  of  the  p  values  on  the  right  are  allocated.  The  computer 
readout  will  provide  each  of  the  seven  p  values,  as  well  as  allocated 
time  9 . 

In  essence,  the  computer  will  look  at  each  product  combination 
separately;  that  is,  the  computer  will  solve  for  p  values  in  the  follow¬ 
ing  equations  based  on  the  requirement  that  To  "  *1  +  fc2  +  *3  +  V 


p 

o 

=  <piHP2.lxp3.lNP4> 

(1) 

p 

0 

=  (p,)(p2  2)(P3  j)(p4) 

(?) 

p 

0 

=  (Pl)(p2.1)'P3.2.1)(P3.2.2)(P4) 

(3) 

p 

o 

=  <PiNp2i  2XP3.  2.  1><P3 . 2.  2><P4> 

(4) 

-  70  - 


Figure  31.  Hypothetical  skeletal  GSSM  for  illustrating  allocation. 


‘f’rrosr;  . 


4 


Allocations  will  be  made  from  among  the  different  values  for  the 
same  p  and  t  such  that  and  requirements  are  always  met. 

If  T  is  less  than  the  sum  of  the  maximum  times  (or  if  T' 
o  .  v 

is  not  specified),  then  p  values  can  be  found  by  applying  the  general 

equation  (5). 

p,  =  k  +  (!  -  k)l.  (5) 


where  j  is  a  subscript  referring  to  a  particular  PEF  Unit,  and 
k  is  a  constant.  Equation  (5)  is  used  to  substitute  k  and  I  values 
in  equations  (1),  (2),  (3),  and  (4)  for  the  right  hand  pj  values. 
For  example,  equation  (1)  is  rewritten  as  follows: 


Pq  .  [k  +  (1-MIj]  [k  +  (l-k)I2  x]  [k  t  (l-kJI^j]  [k+(l-k)I4] 

(6) 

After  solving  equation  (6)  for  k,  each  pj  can  be  found  from 
equation  (5).  Note  that  after  performing  those  steps  for  all  four 
equations,  there  will  be  four  values  of  p^  and  p^f  and  two  values  of 
all  the  others.  The  allocated  probability  for  each  PEF  Unit  will  be 
its  highest  values  from  among  those  computed  for  all  four  equations. 

If  time  is  to  be  allocated  also,  the  computer  operations  are 
much  more  complex.  Since  it  is  very  unlikely  that  a  solution  will 
be  attempted  without  a  computer,  those  operations  are  not  relevant 
to  this  section.  However,  the  equations  can  be  found  in  Appendix  A. 


*  The  same  procedure  is  followed  for  the  similar  equations  derived 
from  equations  (2),  (3),  and  (4).  It  is  likely  that  each  equation 
will  yield  a  different  value  for  k. 
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V.  INPUT  REQUIREMENTS  AND  OUTPUT  CHARACTERISTICS 
OF  TEPPS  COMPUTER  PROGRAM 


A.  Introduction 

To  present  the  information  in  this  section,  it  is  necessary  to 
define  what  is  meant  by  "chains"  and  "segments"  in  a  GSSM.  A 
"chain"  ia  defined  as  a  set  of  PEF  Units  for  which  effectiveness 
requirements  are  specified  prior  to  the  analysis.  A  "segment"  is 
defined  by  time  constraints,  i.e.  ,  when  effectiveness  requirements 
on  time  are  specified  without  corresponding  probability  requirements. 
Both  concepts  will  be  explained  with  reference  to  Figure  32,  a  hypo¬ 
thetical  GSSM  which  will  serve  as  an  example  for  this  section. 

It  should  be  noted  that  TEPPS  Computer  Program  was  originally 
written  in  FORTRAN  IV  for  IBSYS  version  13.9,  to  be  run  on  the 
IBM  7094  computer.  It  is  estimated  to  require  approximately  0.  1 
second  per  PEF  Unit  in  a  single  chain  for  the  computer  to  perform 
all  necessary  computations  to  allocate  probability  and  time  standards 
and  record  results  on  tape.l 


B.  PEF  Unit  Designations  and  the  Definition  of  a  "Chain" 

PEF  Unit  number  designations  were  derived  according  to 
the  procedures  on  pnec  62.  Designation  elements  are  generated 
according  to  series  (elements  in  odd- numhc  red  locations)  and 
parallel  (elements  in  even- numbered  locations)  positioning  of  a 
PEF  Unit  in  the  GSSM.^  In  Figure  32,  the  PEF  Unit  designated  as 


Info  relation  covering  the  availability  of  TEPPS  Computer  Program 
may  be  obtained  from  Psychological  Research  Branch  (PERS  A-32), 
Personnel  Research  Division,  Bureau  of  Naval  Personnel,  Washington, 
D.  C.  20370 

2 

It  may  be  noted  that  the  dot,  or  AND,  symbol  is  treated  as  a  series- 
specifying  condition;  i.  e.  ,  the  segments  to  the  right  of  the  dot  can  be 
considered  the  same  as  if  those  .  egments  were  laid  end-to-end. 
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Numbers  within  squares  are  reference  numbers.  Outside  squares  are  the  number  designations 
for  describing  the  GSSM  structure.  A  number  between  two  dots  is  called  a  designation  element. 


6.3.2.  i.l  can  be  identified  as  follows:  Reading  the  digits  in  reverse 
order,  the  PEF  Unit  is  second  in  a  series  (the  last  "2"  is  element 
No.  5,  i.e.  ,  in  an  odd-numbered  location)  of  two  or  more  PEF  Units; 
that  series  is  first  among  an  alternative  ret  of  two  nr  more  series; 
the  entire  alternative  set  is  second  in  a  series  with  one  or  more  other 
PEF  Units  or  sets;  that  larger  series  is  the  third  of  several  alternative 
scries;  and  the  larger  set  of  alternatives  provides  for  the  sixth  transition 
which  must  occur  to  reach  the  system  output  state. 

If  only  an  overall  SER  is  specified  for  the  system  represented 
in  Figure  32,  then  the  GSSM  can  be  seen  to  contain  20  "chains.  11  of 
which  the  following  are  samples: 

J  -  2  -  3.1.1  -  3.1.2.  3  -  3.1.3  -  4  -  5  -  6.2.1  -  6.2.2  -  6.2.3  -  6.  ?..  4  -  7 

1  -  2  -  3.2.1  -  3.2.2  -  4  -  5  -  6.3. 1  -  6.  3.  2.1.1  -  6.  3.  2.1.  2  -  6.  3.  2.1.  3  -  7 

1  -  2  -  3.2.1  -  3.2.2  -  4  -  5  -  6.  3.  1  -  6.  3. 2.  2.1  -  6.  3.  2.  2.  2  -  6.3.  2.  2.  3.  2  -  7 

Using  the  reference  numbers  (within  the  PEF  Unit  squares)  the  chains 
can  be  listed  so  that  they  are  perceived  more  readily.  The  above 
three  can  be  rewritten  as  follows: 

1  -  2  -  3.6.7  -  10-  11-  13  -  14-  15  -  16-25 
1  -  2  -  8  -  9  -  10-11-17-18-19-20-25 

1  -  2  -  8  -  9  -  10  -  1  1  -  17  -  21  -  22  -  24  -  25 


Assume,  now,  that  the  eight  PEF  Units  with  the  initial  two  digits 
6.3  (Units  17  through  24)  have  a  requirement,  3,  specified  for  it, 
in  addition  to  the  overall  SER  of  RQ.  The  extra  requirement  reduces 
the  number  of  "chains"  to  15.  To  illustrate  how  the  reduction  arises, 
and  to  keep  the  example  simple,  it  will  be  assumed  that  only  the 
elements  3.  2  are  selected  from  the  upper  alternative  group.  That 
leaves  the  following  six  chains: 


1  - 

2  - 

8 

-  9  ■ 

-10- 

11  - 

■  12  - 

2 5 

1  - 

2  - 

8 

-  9  • 

■  10* 

•  n  ■ 

■  13  - 

14 

1  - 

2  - 

8 

-  9  ■ 

.  10  * 

•  11  ■ 

■  25 

17 

-  18 

- 

19  - 

20 

17 

-  21 

~ 

22  - 

23 

17 

-  21 

- 

22  - 

24 
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It  can  be  seen  that  chains  are  groups  of  PEF  Units  for  each  of 
which  standards  can  be  derived.  For  example,  if  the  summation  rule 
holds  tor  the  "k"  Standards,  then  the  MSSMs  corresponding  to  the  six 
chains  would  be: 


R 

R. 

+  R_ 

+  Ra 

+  R„ 

f 

R.  „ 

+ 

R  , 

f 

R  , 

+  R^„ 

0 

1 

2 

8 

9 

10 

1 1 

12 

25 

R 

3 

R, 

+  R, 

+  R0 

X  R 

+ 

R,„ 

+ 

R,  , 

+ 

R 

f  R 

0 

1 

2 

8 

9 

10 

l  1 

1  3 

14 

I  R 

X 

R 

16  ’ 

2*i 

R  -R, 

R, 

+  R, 

+  R 

+  R„ 

+ 

R 

+ 

R 

+ 

R 

a  6. 

3 

i 

8 

9 

10 

1  1 

25 

R, 

R  . 

.  +  R 

_  +  R  + 

R 

6. 

3 

17 

18 

19 

20 

R 


6.  3 


Rl?  +  R21  +  R22  +  R23 


6.  3 


R17  +  R21  +  R22  +  R24 


In  the  third  equation,  allocation  to  elements  in  the  chain  is  baaed  on  the 
difference  between  two  known  requirements.  Note  that  a  complete  path¬ 
way  from  system  input  to  output  is  not  represented  in  the  last  four 
equations,  since  the  6.  3  group  --  which  has  its  own  effectiveness 
requirement  -  -  is  treated  as  a  kind  of  autonomous  subsystem. 

C.  Definition  of  a  "Segment" 

A  chain  is  split  into  segments  when  at  least  one  of  its  component 
PEF  Units  (or  set  of  PEF  Units)  is  constrained  by  a  time  requirement 
without  a  corresponding  probability  requirement.  If  a  chain  contains 
no  such  PEF  Units  the  chain  and  its  single  segment  are  identical. 


As  an  example,  assume  that  Units  21  and  22  in  Figure  3  3  arc 
together  constrained  to  be  performed  within  T  secohds.  Also,  assume 
that  the  eight  PEF  Units  with  the  initial  two  digits  6.  3  (#17  through  #24) 
are  constrained  by  the  probability  requirement,  P&  3,  and  time  limit, 
3.  As  before,  then,  there  are  three  chains  defined  by  the  latter 
requirements: 


17 

17 

17 


-  18  • 
-  21  - 
-  21  - 


19-20 
22  -  23 
22  -  24 
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In  addition,  the  second  two  chains  comprise  two  segments  each,  so  that 
the  three  chains  are  split  as  follows: 

Probability  =  P,  , 

6 .  3 

Time  =  T.  „ 


•  Chain  n  t-  1 

Segment  1 

j_7  -  23 

Segment  2  Time  =  T 

21-  22 

Probability  =  P, 

6  4  i 

Time  =  T,  -  T 
6 .  3 

Segment  2  Time  =  T 

2A  -  22 

D.  Another  Hypothetical  GS5M 

In  order  to  illustrate  the  input-output  requirements  of  TEPPS 
Program,  the  simpler  GSSM  shown  in  Figure  3  3  will  be  used. 

That  GSSM  served  as  the  "system"  on  which  the  computer  program 
was  actually  originally  tested. 

The  following  effectiveness  requirements  were  assumed: 

1.  An  overall  probability  (PQ)  of  achieving  the  system 
output  within  time,  TQ: 

P_  =0,86  T  a  170  seconds 

o  o 

2,  Probability  and  time  constraints  or.  unit  [3,  4,  or  5] 
and  unit  6: 

P2.1.<2,3)  “°'96  TZ.i.  (2,  3)'  24 


•  Chain  n  f  2 

Segment  1 

17-24 


Probability  =  P,  , 
6 .  3 

Time  =  T.  •  T 
o .  i 


•  Chain  n 

Segment  1 

-  J_8  -  P)  -  20 


-‘r  ti  iia  in m 


-  77  - 


ID=2l 


3.  Probability  and  time  constrains  on  unit#  9  through  15: 

P,  ,  -  o.  94  T_  sHO  seconds 

2,  3  2.3 

4.  A  time  constraint  on  unit  12: 

T  ,  ,  ,  -  9  seconds 

5.  A  time  constraint  un  unit  lb 

T  ^  *  40  seconds 

6.  A  time  constraint  on  unit  17; 

T  .  -  40  seconds 
4 

As  a  result  of  the  imposed  conditions,  nine  chains  and  their  component 
segments  can  be  identified  as  shown  in  Table  III. 

Table  III.  Chains  and  Segments  in  the  Example 

(Entries  arc  the  numbers  lying  inside  the  squares  in  Figure  33.) 


Chain 

Segments  j 

1 

2 

3 

a 

1-7. 

16 

17 

b 

1-7-8 

16 

17 

c 

1 

16 

17 

d 

3-6 

& 

4-6 

f 

5-6 

g 

9-10-11 

h 

9-13 

12 

i 

9-14-5 

12 

As  will  be  seen,  the  computer  output  identifies  chains  with  reference 
to  the  probability- time  effectiveness  requirements  imposed  on  the  system, 
rather  than  by  letters,  as  was  done  in  Table  III. 


E ,  Input  Data  for  the  Program 


There  arc  eight  sets  of  data  card*  required  hy  the  program. 
These  will  be  described  in  the  sequence  in  which  they  must  occur 
following  the  program  deck  Note  that  the  odd-numbered  card 
"sets"  --as  well  as  the  tast  one—  contain  only  one  card.  Sets  #2, 
§4,  and  #6  must  contain  at  least  two  cards. 


#1  $DATA  punched  in  the  first  five  columns  of  the  first  card. 
(One  card  only, ) 


#2  Activity  Description  Cards 

(All  relevant  Data  Store  information  for  all  activities  in  the 
GSSM:  these  must  be  arranged  in  increasing  Activity  I,  D.  order. 
From  this  set  the  program  uses  only  those  corresponding  to  the 
ones  specified  by  each  PEF  Units'  Activity  I.  D.  in  set  #4,  below.  ) 

Each  of  these  cards  contains  numerical  Data  Store  information; 
currently,  that  information  consists  of  the  following; 


(a) 

(b) 

(c) 

(d) 


Activity  I.  D.  (identification  number)  in  columns  2 
through  5 . 

IOTA  (Ij)  in  columns  6  through  14. 

Minimum  time  (Tmjn.)  in  columns  15  through  2.3, 
Maximum  time  (Tmax  )  in  columns  24  through  32. 


EXAMPLE:  Assume  that  the  Data  Store  contains  i  00  activities. 
Thus,  there  will  be  100  cards  in  this  set;  the  first  three  and  the 
last  one  might  appear  as  shown  in  Figure  34, 


Terminator  Card 
(One  card  only. ) 

This  card  has  any  non-zero  integer  punched  in  the  first  column. 
It  is  used  to  signal  the  computer  that  there  are  no  more  Activity 
Description  cards. 


*i*4  Network  Description  CardB 

(Number  of  cards  equals  number  of  PEF  Units  in  GSSM.  ) 


Each  card  represents  one  PEF  Unit.  It  contains  the  number 
designation  from  the  GSSM,  plus  the  PEF  Unit's  Activity 


80  - 


IDeptificatson  number  from  the  Data  Store.  Element*  in  ine 
GSSM  number  designation  appear  in  order  with  the  first 
designation  el»ment  in  columns  2  and  3,  the  second  in  columns 
5  and  6,  the  third  in  columns  8  and  9,  and  so  on  through  column 
66.  Each  element  in  the  number  designation  must  lie  between 
1  and  99,  inclusive.  The  Activity  I.  D.  is  punched  in  columns 
69-72. 

EXAMPLE:  The  PEF  Unit  having  the  number  designation 
2,  3. 2.  2,  1  (or  #12)  is  assumed  to  be  activity  number  75  in  the 
LAMA  Data  Store.  Thus,  the  data  card  for  this  PEF  Unit  would 
be  punched  as  shown  in  Figure  35. 


Column 

No. 

12  3  4 

k 

5  6  7  S  9 

10  11  12  13  14  15  16  • 

i  i 

.  6°  70  71  72  73  . 

o 

CO 

Punched 

1  1 

1 

1  1 

Data 

2 

3  2 

2 

1 

7  5 

Figure  35.  One  of  the  Network  Description  Cards  in  the  example. 


In  the  GSSM  of  Figure  33  there  are  17  PEF  Units.  Thus,  after 
the  first  "1  -.  rminator  Card"  there  would  be  17  Network  Descrip¬ 
tion  cards.  Although  they  need  not  be  in  order,  it  helps  later 
interpretation  if  cards  are  arranged  in  increasing  order  accord¬ 
ing  to  number  designations  (numbers  inside  the  squares  in 
Figures  3  2  and  33). 


5.  Terminator  Card 

(One  card  only,  with  a  non- zero  integer  punched  in  the  first  column.  ) 

Same  as  #3.  This  card  signals  the  computer  that  there  are  no 
more  Netwoik  Description  cards. 

6.  Probability- Time  Cards  (*--T  Cards) 

(One  pair  of  cards  for  the  SER  and  one  pair  for  each  ER  to  be 
imposed  on  any  one  or  a  group  of  PEF  Units  within  the  system.  ) 

These  cards  are  arranged  in  successive  pairs.  The  first  card 
of  each  pair  identifies  the  particular  group  for  which  an  ER  is 
specified;  that  is,  the  first  card  lists  the  initial  number  designa¬ 
tion  elements  common  to  all  PEF  Units  in  the  group  of  interest. 

For  '■he  total  system,  die  first  card  is  entirely  blank. 


When  values  are  appropriate  for  the  first  card,  however,  then 
the  first  element  of  the  number  designation  is  punched  in 
columns  2  and  3,  the  second  in  columns  5  and  6.  and  so  on 
through  column  66;  this  is  the  sanv-  fft-mat  as  ’-sed  in  the 
Network  Description  cards  (but  v'ithout  Activity  I.  D.  ). 

The  second  card  of  each  pair  has  the  same  format  as  the  first 
card  tor  the  first  58  columns.  On  this  card,  the  numbers  in 
columns  2  and  1,  5  and  6,  etc.  ,  are  the  elements  which  follow 
those  appearing  on  the  first  card;  they  delimit  the  subgroups 
within  the  group  for  which  probability  and  time  standards  have 
been  specified.  Elements  on  the  second  card  are  unrelated  to 
one  another,  but  each  are  related  to  (they  actually  follow.  .  .  ) 
the  elements  on  the  first  card  of  the  pair.  For  the  entire 
system,  columns  i  through  58  on  the  second  card  will  be  blank. 

In  addition,  columns  59  through  67  of  the  second  card  contain 
the  probability  component,  of  the  ER ,  and  columns  68  through  76 
contain  the  time  component,  both  including  decimals.  (If  no 
decimal  is  included,  the  computer  will  automatically  put  one 
between  the  digits  in  columns  62  and  63,  and  between  those  in 
columns  71  and  72.) 

EXAMPLE:  Twelve  P-T  cards  are  needed  to  specify  the  effec¬ 
tiveness  requirements  listed  on  pages  77  and  79.  The  six  pairs 
of  data  cards  are  illustrated  in  Figure  36.  The  second  pair 
deserves  special  attention. 

Since  there  are  three  groups  of  PEF  Units  beginning  with  2.  1, 
and  since  only  two  of  the  three  are  specified  to  lie  within  a  require¬ 
ment,  the  subgroups  are  indicated  on  the  second  card.  Thus,  the 
second  pair  of  P-T  cards  delimits  the  requirements  of  all  Units 
beginning  with  2.1,2  and  2,  1 .  3,  and  thereby  omits  2.1.1  (and 
2.1.4,  2.1.5,  etc.  ,  if  they  existed).  * 


*It  may  be  noted  that  requirements  could  be  specified  for  a  non-adiacent 
set  of  units,  e.  g.  ,  the  requirements  on  the  second  pair  of  P-T  cards 
could  have  referred  to  sets  beginning  2. 1.  1  and  2,1.3.  Requirements 
can  be  specified  for  either  adjacent  or  non-adjacent  series  units  which 
do  not  lie  in  an  alternative  set.  For  example,  if  there  were  two  more 
units  in  series  following  #16  and  #\7,  so  th.  t  they  would  be  designated 
aB  5  and  6,  effectiveness  requirements  associated  with  elements  l,  5, 
and  6  would  be  indicated  by  (a)  leaving  the  entire  first  card  blank 
--thereby  indicating  to  the  computer  that  reference  is  made  to  the  main¬ 
line  of  the  system-- and  tb)  punching  1  in  the  third  column,  5  in  the 
sixth  column,  and  6  in  the  ninth  co’umn  of  the  b econd  card  of  the  pair, 
along  with  probabil  ity  and  time  requirements. 
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Figure  36.  Pairs  of  Probability- Time  (P-T)  Cards  for  the  example. 


m 


Terminator  Card 
(One  card  only. ) 

Same  as  for  #3  and  #5,  except  that  the  numbers  8  and  9 
have  a  special  significance.  The  card  signals  the  end  of  the 
probability-time  cards  and  also  indicates  to  the  computer  what 
to  expect  next,  The  computer  interprets  any  digit  in  the 
first  column  except  8  or  9  to  mean  that  there  are  absolutely 
no  more  data.  If  the  number  9  appears  in  the  first  column,  the 
computer  is  triggered  to  go  back  to  the  beginning  of  the  program 
and  start  again,  so  it  seeks  data  sets  §2  through  #7,  as  if  to 
analyze  different  GSSMs.  The  number  8  in  the  first  column 
triggers  the  computer  to  return  to  #4;  by  using  this  signal, 
different  configurations  of  alternatives  can  be  analyzed  for 
the  same  GSSM,  referring  to  the  same  activity  ID  information 
as  before, 


#8  End  of  File  Card 
(One  card  only. ) 

Usually,  this  card  contains  $EOF  in  the  first  four  columns. 
This  signals  the  computer  that  there  are  absolutely  no  more 
data  cards  (or  any  other  cards)  to  be  read. 


F.  Output 

The  computer  internally  assigns  sequential  reference  numbers 
to  the  PEF  Units,  starting  with  1,  according  to  increasing  GSSM 
number  designations.  Those  assigned  numbers  correspond  to  the 
numbers  which  appear  inside  the  squares  in  the  GSSMs  of  Figures  32 
and  33. 

The  program  generates  three  sets  of  output  information  in  the 
following  order: 

#1  Tables  of  Input  Data 

Two  tables  are  presented  summarizing  the  relevant  data  fed 
into  the  computer.  The  first  lists  the  system  PEF  Units  with 
their  identification  numbers  and  their  corresponding  IOTA, 

Tmjn  and  Tmai£  values  (see  Table  IV).  The  second  summarizes 
the  data  on  the  pairs  of  Probability- Time  Cards  (see  Table  V), 
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§ 2  Standards,  by  Individual  Chains  anti  Segments 

Effectiveness  requirements  are  allocated  to  PEF  Units  lying 
within  referenced  chains  and  segments.  Chains  ond  segments 
are  listed  according  to  the  Probability- Time  Card  from  which 
they  are  derived  (as  specified  by  "Card  No.  "  in  Table  V).  Table 
VI  presents  the  data  for  the  first,  second,  fourth,  and  ninth  chains 
exactly  as  they  arc  printed  out  by  the  program.  The  remaining 
five  chains  have  the  same  form  (they  are  not  included  in  order  to 
conserve  space). 

13  Standards  Satisfying  AH  Imposed  Effectiveness  Requirements 

The  results  detailed  in  the  above  Output  Set  #2  are  summarized  in 
two  tables,  both  containing  essentially  the  same  information.  In  the 
process  of  allocating  to  the  components  of  each  chain,  the  computer 
determines  the  maximum  probability  and  minimum  time  standards 
from  among  all  the  standards  assigned  to  each  PEF  Unit.  At  the  end. 
then,  the  computer  prints  those  values  according  to  "Element  Number" 
(Table  VII)  and  then  again  according  to  "Activity  I.  D.  "  (Table  VIII). 

The  first  table  lists  the  standards  for  PEF  Units  as  they  occur  in 
the  GSSM.  However,  an  activity  may  occur  more  than  once  in  the 
operation  of  a  system,  and  it  may  be  of  interest  to  know  the 
standards  for  activities  directly,  rather  than  for  their  orientation 
in  the  GSSM.  Thus,  the  second  table  lists  probability  and  time 
standards  according  to  activity. 


G.  Special  Considerations 

Certain  precautions  need  to  be  observed  for  the  computer  to 
function  within  the  bounds  of  the  assumptions  underlying  the  method 
by  which  standards  are  derived. 

1,  Increasing  error  will  accrue  if  the  effectiveness  require¬ 
ment  on  probability  for  a  chain  is  much  greater  than  the  IOTA  for  any 
one  component  PEF  Unit.  Resulting  allocated  probability  standards 
are  likely  to  be  so  close  to  1.0  that  they  will  be  indistinguishable. 

2,  For  any  segment,  the  effectiveness  requirement  on  time 
should  never  be  much  less  than  the  sum  of  the  Tmjn  values  of  the 
component  PEF  Units.  If  the  sum  of  Tmin  is  largo  relative  tothe 
time  requirement,  then  the  probability  standards  for  the  component 
PEF  Units  will  tend  to  be  equal,  independent  of  their  IOTA  values. 
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VI.  ESTABLISHING  STANDARDS  FOR  CORRECTIVE  MAINTENANCE 


I 


A.  Introduction 

The  general  approach  to  establishing  corrective  maintenance  performance 
standards  is  to  allocate  overall  system  or  equipment  maintenance  time 
requirements  to  general  categories  of  maintenance  actions  required  to  re¬ 
store  the  system  or  equipment  following  a  failure.  Only  performance -time 
standards  are  applicable  to  corrective  maintenance  tasks  since  it  is  assumed 
that  the  probability  of  successfully  completing  each  maintenance  task  is 
equal  to  unity.  * 

Since  a  system  failure  potentially  constitutes  the  output  state  of  any 
personnel/equipment  functional  unit,  the  occurrence  of  a  maintenance  task 
can  be  incorporated  in  the  graphic  system  state  sequence  model  as 
illustrated  below: 


* 

-*•- 

I 

I 

V 

¥ 

u 

•» 

£ 

k 

* 

i 


Due  to  the  fact  that  the  probability  of  failure  and  the  associated  mainte¬ 
nance  need  only  be  introduced  at  the  most  general  level  of  modeling,  it  is 
not  necessary  to  include  failure  and  maintenance  considerations  in  the  detailed 
graphic  and  mathematical  state  sequence  models  used  to  represent  operator 
performance.  However,  the  graphic  state  sequence  model  defines  the 
physical  limits  of  the  system  or  equipment  for  which  maintenance  time 
standards  are  to  be  established. 


1 

The  probability  of  completing  maintenance  subtasks  (e.  g. ,  fault  isolation, 
disassembly,  etc.),  however,  are  not  necessarily  equal  to  unity.  When 
subtask  errors  do  occur,  they  have  the  effect  of  lengthening  overall 
task-time. 


uL 
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1.  Source  System  Effectiveness  Requirements 


System  effectiveness  requirements  constituting  the  source  of 
corrective  maintenance  time  requirements  are  availability  or  dependability 
requirement#  associated  with  the  type  of  mission  the  system  or  equipment 
must  perform.  Two  of  the  most  common  measures  are  point  availability 
and  dependability.  Point  availability  is  the  expected  probability  that  a 
repairable  system  or  equipment  will  be  operating  (non-failed)  to  any 
random  point  in  time.  Dependability  is  the  probability  of  successfully 
completing  a  mission  of  a  specified  duration  providing  that  in  the  event  of 
failure)  downtime  will  not  exceed  a  specified  duration.  Mathematical 
definition*  for  those  and  other  measures  appropriate  to  a  wide  variety  of 
Navy  missions  are  given  in  Table  DC. 

Once  the  availability  or  dependability  measure  is  specified  and 
system  or  equipment  reliability  is  determined,  the  requirement  for  overall 
maintenance -time  is  uniquely  established.  As  an  illustration,  if  the  point 
availability  (Ap)  requirement  is  0.  99  and  the  mean  time  between  failures 
(MTBF)  is  100  hours,  mean  time  to  restore  (MTTR)  is  calculated: 


MTBF 


MTBF  +  MTTR 


0.99 


100 


100  + MTTR 


and  MTTR  a  1.01  hours 


2.  Allocation 


Given  an  overall  MTTR  requirement,  the  next  task  is  to  allocate 
times  for  completing  general  categories  of  maintenance  actions  required 
to  restore  the  system  or  equipment.  This  1b  done  using:  (1)  an  expression 
relating  (a)  overall  MTTR,  (b)  failure  rates  for  various  portions  of  the 
system  or  equipment,  and  (c)  maintenance  times  for  those  portions;  and 
(2)  a  basis  for  time  allocation.  The  relation  among  system  or  equipment 
MTTR,  failure  rates  and  times  for  general  categories  of  maintenance 
actions  is  given  by: 


MTTR  ■  (  Z  XiRi  )  /  E  X* 


(1) 


where:  ^ 

Rj  a  required  mean  time  to  carry  out  the  ith  category  or  type 
of  maintenance  (i.e.,  maintenance -time  standard  for  the 
ith  category  of  maintenance) 
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\l  *  failure  rate  uf  the  portion  of  the  system  or  equipment 

maintained  with  the  ith  category  or  type  of  maintenance; 
and 

n  «  mimber  of  different  categories  or  type#  of  maintenance. 
Equation  {1}  can  be  rewritten: 


MTTR  a  "  (Wxt)  Ri  - 
i-1 


U) 


or 


n  _ 
MTTR  ■  E  C.  Ri 
i=l  1 


where: 

^  *  E  X^,  the  total  failure  rate  of  the  system  or  equip- 

iatl 

ment,  and 

Ci  »  Xi/Xf  the  failure  rate  allocation  coefficient. 
Allocation  is  accomplished  by  first  computing  a  Repair  Index,  RI: 


(3) 


n 

RI  »  E  CjTj  (4) 

is  I 

where: 

Tj  a  a  time  index,  where  the  ratio  T^/Tj+i  is  the  ratio 
of  expected  times  to  perform  the  ith  and  ith  +  1 
categories  of  maintenance. 

Next  an  allocation  constant  K  is  computed: 

K  a  MTTR/RI  (5) 

Equations  (3)  and  (4)  are  combined  with  the  use  of  equation  (5): 

K  a  (  E  CiRi)  /  (  E  CiTi)  (6) 

'  ial  '  M=1  / 

and  maintenance  time  performance  standards  are  computed  from  equation  (6): 
Ri  »  KTi 
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In  carrying  out  the  allocation  a»  outlined  above,  the  allocation 
coefficients  may  be  calculated  rcadi.ly  using  system  or  equipment  reliability 
data.  Time  indices  have  been  derived  from  maintenance  burden  prediction 
data  developed  for  the  U.S.  Navy  bureau  of  Naval  Personnel.  ^  The  time 
indices  are  given  in  Tabic  X  together  with  the  maintenance  categories  with 
which  they  are  associated. 

The  maintenance  categories  are  identified  according  to  two  design 
features  which  account  fur  a  major  portion  of  variability  in  maintenance- 
time:  (1)  the  functional  level  at  which  fault  isolation  features  are  effective: 
and  {£)  functional  level  of  fault  correction.  (Functional  levels,  defined  in 
Tabic  XIi  denote  the  physical/or ganizationsl  hierarchical  levels  of  electronic 
equipment.)  The  relation  between  those  design  features  and  nu intenance - 
time  follows  front  the  effect  they  have  on  the  extent  of  complex  troubleshooting 
required  of  the  technician.  Built-in  fault  isolation  features  usually  permit 
the  technician  to  isolate  faults  by  observing  simple  input-output  relations. 
Below  the  level  at  which  fault  isolation  features  are  effective,  more  complex 
diagnostic  activities  arc  grnerally  required.  Thus,  the  extent  of  required 
complex  troubleshooting  dec  reuses  as  isolation  features  are  provided  at 
lower  functional  levels  in  the  system  or  equipment  hierarchy.  Bracketing 
the  extent  of  required  complex  troubleshooting  in  the  other  direction  is  the 
method  by  which  faults  are  corrected.  If  fault  correction  is  effected  by 
replacing  higher  functional  levels  (through  modular  design),  it  becomes 
unnecessary  to  carry  out  fault  isolation  to  the  part,  stage  or  subassembly 
levels. 

B.  Procedure 


The  steps  required  to  establish  corrective  maintenance-time  standards 
are  illustrated  with  data  for  the  AN/URC-3.I  Radio  Set. 

Step  1:  Determine  the  System  or  Equipment  MTTR  Requirement 

Determine  the  overall  system  or  equipment  MTTR  by  substituting 
numerical  values  of  the  system  effectiveness  requirement  and  system  or 


Manheimer,  B.H.  et.  al.  Predicting  the  Corrective  Maintenance  Burdrn, 
Volume  I:  Prediction  Study.  Federal  Electric  Corp.  ,  Paramus,  New 
Jersey,  30  April  1963.  Those  data  in  turn  are  based  on  maintainability 
prediction  data  given  in  MIL-M-23  3 1 3A(SH1PS),  Maintainability  Require¬ 
ments  for  Shipboard  and  Shore  Electronic  Equipment  and  Systems, 

9  October  1963. 
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Table  X 


Maintenance  Category  Time  Indices 


1 . 1  11 11 — - . . . .  f  

Fault  Correction  Level 

Level  at  which  Fault  Isolation 
Features  are  effective 

Time 

Index 

Part 

No  isolation  required1 

0,  66 

Part 

1.43 

Stage 

1. 84 

Subassembly 

2.  07 

Assembly 

2.  a 

Unit 

2.  36 

Group 

*1.48 

Equipment 

2.58 

No  isolation  features 

2.  83 

"" 

Module  Replacement 

No  isolation  required1 

0.  51 

(Subassembly,  Assembly,  or 
Unit) 

A  Functional  Level^  =  0 

0.  78 

if  it  n  =  i 

0.  83 

"  "  "  3  1 

0.  90 

"  •»  "  -  3 

1.02 

l»  It  II  3  4 

1. 28 

It  II  II  _  £ 

1.51 

_ 

Fault  isolated  by  observation  of  operating  displays  or  through  the  use  of 
automatic  fault  isolation  equipment. 

"A  Functional  Level"  represents  the  number  of  functional  levels  between 
the  level  at  which  isolation  features  are  effective  and  the  level  at  which 
fault  correction  takes  place.  Thus  if  the  assembly  is  the  fault  correction 
level  and  isolation  features  are  effective  at  the  assembly  level,  the  A 
Functional  Level  i  ,  0.  If  the  subassembly  is  the  lault  correction  level  and 
isolation  features  are  effective  at  the  unit  level,  A  Functional  Level  =  2, 


101  - 


equipment  reliability  into  the  appropriate  availability  or  dependability 
model  {Table  II).  For  example,  if  it  is  assumed  that  the  System  Effective¬ 
ness  Requirements  (SER)  for  the  AN/URG-32  include  a  required  point 
availability  of  0.  998  and  that  the  equipment  has  an  MTBF  of  790  hours, 
the  MTTR  requirement  is  calculated: 


A  = 


_ MTBF _ 

MTBF  t  MTTR  J 


0.  998 


790 

790  +  MTTR  : 


MTTR  =1.5  hours 


Step  2:  Partition  the  System  or  Equipment  into  Maintenance  Categories 

The  categories  of  maintenance  considered  in  the  allocation  are  listed 
in  Table  III  and  are  identified  by  the  functional  level  at  which  faults  are 
corrected  and  the  functional  level  at  which  fault  isolation  features  are 
effective. 

Partition  the  system  or  equipment  into  those  maintenance  categories 
by  determining  the  system  or  equipment  functional  level  breakdown.  That 
is  done  by  dividing  the  equipment  or  system  into  its  various  physical  sub¬ 
divisions,  beginning  with  the  highest  subdivision  and  continuing  down  to 
levels  such  as  parts,  subassemblies,  assemblies  or  units  that  will  be 
replaced  in  corrective  maintenance  as  illustrated  in  Figure  37,  *  Also 
determine  the  isolation  levels  or  levels  at  which  maintenance  personnel  can 
isolate  the  malfunction  using  designed  test  points  or  other  built-in  isolation 
features  for  each  portion  of  the  equipment.  The  isolation  levels  should  be 
indicated  on  the  functional  level  diagram  as  indicated  in  Figure  37. 
Identification  of  isolation  and  replacement  levels  as  described  above  permits 
classification  of  various  portions  of  the  system  or  equipment  according  to 
the  maintenance  categories  listed  in  Table  X.  Preparation  of  a  functional 
level  breakdown  of  the  AN/URC-32  indicates  that  seven  types  of  maintenance 
are  performed  on  the  equipment  as  indicated  in  Figure  3  8.  2 

Step  3:  Determine  the  Failure  Rate  Associated  with  Each  Maintenance 

Category 

Determine  the  failure  rates  for  portions  of  the  system  or  equipment 
associated  with  each  maintenance  category  using  failure  rate  prediction 


Construction  of  functional  level  diagram  is  covered  in  detail  in  MIL-M- 
233 13A,  p.  26  ff. 

Failure  rate  and  functional  level  breakdown  data  for  the  AN/URC-32 
were  obtained  from  Manheimer,  B.  H.  op,  cit,  ,  1963. 
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Figure  37.  Illustrative  functional  level  diagram. 


MAINTENANCE  TIME  ALLOCATION  FORM 


procedures.  *  Tabulate  failure  rates  on  the  Maintenance -Time  Allocation 
Form  shown  in  Figure  38  by  unit  {or  other  convenient  functional  level) 
according  to  the  type  of  maintenance  performed.  Sum  those  rates 
across  all  units  to  obtain  a  total  failure  rate  for  each  maintenance  category 
as  shown  in  Figure  38,  Divide  the  total  failure  rate  for  each  maintenance 
category  by  the  total  failure  rate  for  the  system  or  equipment  to  obtain 
failure  rate  allocation  coefficients,  Cj. 

The  following  failure  rate  data  for  the  AN/URC-32  are  obtained  from 
Figure  3  8. 


Type  of  Maintenance 
Replacement 


Maintenance 

Category 


Failure  Rate 
Allocation  Coefficient 


** 

Level 

Isolation  Level 

Failure  Rate 

(Categor 

y  X  /Total 

Part 

Part 

2.  85 

C  2  = 

.002 

Part 

Stage 

326.68 

C3  = 

.258 

Part 

Subassembly 

79.  12 

C4  3* 

.062 

Part 

Assembly 

40.68 

C5  = 

.032 

Part 

Unit 

59.64 

C6  = 

.047 

*• 

Module 

Not  Required 

26.08 

c10  = 

.021 

Module 

A  Functional  Level  =  0 

732. 34 

Cll  ■ 

.578 

11 

•  H 

O 

w 

1.000 

Step  4:  Allocate  Overall  MTTR  to  Each  Category  of  Maintenance 


Allocate  overall  MTTR  on  the  basis  of  the  frequency  of  maintenance  for 
each  category  and  maintenance  category  complexity  as  follows: 


Use  NAVSHIPS  93820  (Method  C  or  D)  or  MIL-HDBK-2 17.  Other  pro¬ 
cedures  are  available  for  failure  rate  prediction  at  early  points  in  the 
design  cycle:  see  for  example:  Westland,  R.A.  and  Hanifan,  D.  T.  A 
Reliability -Maintainability  Trade-Off  Procedure  for  Navy  Electronic 
Equipment,  Dunlap  and  Associates,  Inc.,  Santa  Monica,  California, 
June  1963,  p.  3-125  ff. 
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a.  Compute  the  Repa  ir  Index,  RI: 

n 

RI  a  z  C.T. 

is  1 

where  C^'s  are  the  failure  rate  allocation  coefficients  calculated 
in  Step  3,  and  Tj's  are  the  time  indices  given  in  Table  111. 

Thus, 

RI  m  0.66  Ci  +  1.43  Ci  +  1.84  C3  +  2.07  C4  +  2.23  C5  + 

2.36  Cf,  +  2.48  C7  +  2. 58  C8  +  2.  83  C9  +  0.51  C10  + 

0.78  Cn  +  0.83  C 12  +  0.90  C 13  +  1.02  C 14  +  1.28  C 15  + 

1.51  C16 

b.  Compute  the  allocation  constant  K  *  MTTR/RI,  where  Ml TR  is 
the  required  system  or  equipment  restore  time  determined  in 
Step  1. 

c.  Compute  the  maintenance -time  performance  standards  for  each 
category  or  type  of  maintenance,  Rj  at  KTj. 

For  the  AN/URC-32,  the  following  results  are  obtained  by  using  the 
data  given  in  Figure  3  8. 

RI  ■  0.66(0)  +  1.43(.  002)  +  1.  84(.  258)  +  2.  07(.  062)  +  2.2 3(.032)  + 

2.  36(.  047)  +  2.48(0)  +  2.58(0)  +  2.83(0)  +  0.5l(.02l)  + 

0.  78(,  578)  +  0.83(0)  +  0.90(0)  +  1.02(0)  +  1.28(0)  +  1.51(0)  s 
1.25 

The  allocation  coefficient  is  computed: 

K  *  MTTR/RI  ■  1.5/1.25  »  1.2 

The  maintenance  time  performance  standards  are  obtained  by  multiply 
ing  the  allocation  coefficients  by  K. 


Type  of  Maintenance 


Replacement 

Level  Isolation  Level 


Allocation  Maintenance  Time 
Coefficient,  Ci  Standard,  Ri 


Part 

Part 

1.43 

1.  72 

Part 

Stage 

1.  84 

2.21 

Part 

Subassembly 

2.  07 

2.48 

Part 

Assembly 

2.23 

2.68 

Part 

Unit 

2.  36 

2.  83 

Module 

Not  Required 

0.  51 

0.61 

Module 

A  Functional  Level  =0 

0.78 

0.94 

It  should  be  noted  that  the  proportional  adjustment  carried  out  above  in 
arriving  at  maintenance -time  standards,  is  identical  in  approach  to 
allocating  standards  to  operator  PEFUnits  when  only  probabilities  of 
successful  accomplishment  are  involved  in  the  allocation. 
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VII,  INTERPRETATION  OF  RESULT'S 


A.  Introduction 

There  are  basically  two  levels  at  which  the  results  of  TEPPS  applica¬ 
tion  can  be  interpreted: 

.  Comparisons  between  different  sets  of  standards  obtained  by 
having  looked  at  different  patterns  from  among  alternative 
sets  of  PEF  Units;  that  is,  the  probability  and  time  values 
themselves  are  meaningful  when  more  than  one  of  each  is 
associated  with  the  same  PEF  Unit. 

.  Comparisons  between  results  and  expectations  of  human 
performance  capabilities,  thus  reflecting  the  adequacy  of  a 
particular  personnel/equipment  system  design  in  meeting 
mission  requirements. 

B.  Comparisons  Among  Different  Sets  of  Standards 


Figure  39  illustrates  an  example  of  the  results  of  the  allocation  process 
when  two  alternatives  are  treated  individually;  for  the  situation  depicted, 
the  process  produces  two  sets  of  standards  for  each  PEF  Unit  which  is 
not  a  member  of  a  set  of  alternatives.  The  numbers  in  the  illustration 
were  generated  for  purposes  of  demonstration  and  are  not  founded  on  any 
actual  values.  The  upper  standards  represent  the  outcome  of  omitting 
PEF  Unit  2.2  fiom  the  data  deck  entered  into  the  computer.  The  lower 
values  result  from  omitting  PEF  Unit  2.  1.  It  may  be  noted  that  if 
elements  2.  1  and  2.2  were  both  entered  into  the  computer,  the  emerging 
single  set  of  standards  would  be  as  follows: 


.975 

*2.1  =  -90 

P2.2  a  •" 

P3  ■  .98 

1.5 

*2.1  s  3 

*2.2  ~  4 

tj  s  2.5 

From  these  values,  it  can  be  seen  that  the  .85  probability  requirement  is 
always  satisfied  --  or  exceeded  --  within  the  required  time,  eight  minutes. 

T0  =  1.5  +  3  +  2.5  a  7  or 
TQ  *  1. 5  +  4  +  2. 5  a  8  and 


P0  *  (-975)  (.90)  (.98)  =  .  85  or 
PQ  .  (.975)  (.99)  (.98)  *  .945 
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Returning  to  the  example  in  Figure  39  some  comment*  can  be  made 
about  the  result*  without  identifying  any  activities  and  without  knowing 
about  man's  capabilities.  The  only  knowledge  available  i*  that  (1)  three 
PEF  Units  are  required  to  be  performed  in  succession;  (2)  one  of  the 
three  is  either  PEF  Unit  2.  i  or  2.2;  and  (3)  the  system  makes  it 
possible  for  the  operator  to  select  whichever  alternative  he  wishes. 

If  the  operator  chooses  to  select  2.  2  (oi  if  he  is  forced  to  do  so  by 
an  alteration  in  original  system  design)  the  probability  requirements  on 
PEF  Units  No.  1  and  No.  3  become  much  lower  than  if  2.  1  were  used. 

Thus,  if  it  is  economically  feasible  and  reasonable,  it  may  be  worth 
the  effort  to  redesign  the  system  so  as  to  preclude  performance  of  2.  1. 

As  a  result,  more  error  could  be  tolerated  in  performing  No.  1  and  No.  3 
if  further  investigation  reveals  that  the  higher  demands  made  by  2.  1  on 
No.  1  and  No.  3  may  be  difficult  to  meet. 

Consideration  of  time  as  well  as  probability  allocations  lead  to  the 
following  questions  which  can  be  answered  only  through  examination  of 
human  capability  information: 

For  either  alternative, 

.  Are  the  allocated  times  reasonable  for  achieving  the 
associated  probability  of  accomplishing  the  activities? 

.  If  both  alternatives  are  permitted  (i.e. ,  if  the  system  stands 
as  shown  by  the  GSSM)  is  it  possible  to  meet  the  more 
stringent  time  and  probability  standards? 

,  Is  2.  2  more  costly  to  implement  than  2.  1,  and  if  so,  is  the 
trade-off  to  increase  the  likelihood  of  meeting  the  SER 
economically  feasible  and  desirable? 

.  And  particularly  regarding  these  data,  is  there  any  specific 
reason  for  the  system  to  permit  the  possibility  of  alternative 
operations  having  such  divergent  relative  probabilities  of 
accomplishment  ? 

If  evaluation  of  alternative  routes  yields  essentially  the  same  alloca¬ 
tions  throughout  the  system,  it  would  be  concluded  that  the  alternatives 
are  functionally  equivalent  and  that  no  distinction  need  be  made  between 
them  unless  changes  are  to  be  made  in  the  system.  It  is  to  be  noted  that 
even  though  a  set  of  alternatives  leads  to  the  same  allocation  for  a  particular 
system  configuration,  that  does  not  guarantee  the  same  outcome  for 
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Once  standards  have  been  allocated  to  system  PEF  Units,  the  question 
arises  as  to  how  well  those  standards  can  be  met.  Two  primary  concerns 
are  (a)  interpreting  results,  and  { b)  obtaining  indications  of  what  to  do 
about  discrepancies.  Since  the  fundamental  goal  of  the  technique  is  to  aid 
in  the  development  of  the  most  effective,  feasible  system  to  accomplish 
the  requirements  of  the  mission  assigned,  it  i.  necessary  to  find  the  optimal 
match  between  personnel  performance  levels  required  by  a  particular  system 
design  (standards)  and  the  performance  levels  that  can  be  expected  from 
personnel  being  considered  for  assignment  to  that  system. 


Fe*  the  method  to  be  employed  *or  that  purpose,  some  form  of  personnel 
capability  or  expectancy  data  are  required.  Sj.  (for  "capability  standard") 
is  the  symbol  used  here  to  represent  the  probability  with  which  a  human 
can  be  expected  to  perform  all  system  operations  for  which  a  system 
effectiveness  requirement  has  been  establlsncd.  Corresponding  to  Sc  is 
the  system  required  value,  PD,  symbolized  by  (for  "required  standard"). 

It  (vis  been  mentioned  that  at  present,  no  comprehensive  and  fully  reliable 
store  of  human  performance  capability  data  is  available.  In  the  absence  of 
behavioral  data  store  expectancies,  however,  capability  data  can  be 
obtained  on  the  specific  personnel  group  being  conside  red  for  assignment 
to  the  system  by  measuring  the  performance  of  that  group  on  the  PEF  Units 
resulting  from  the  standards  derivation  process.  Another  source  would  be 
proximate  data  obtained  from  previous  studies  of  personnel  operations  that 
are  comparable  to  those  required  by  the  system  under  analysis,  if  any  can 
be  found.  A  third  source  could  be  the  combined  e9timas.es  made  by  a  number 
of  knowledgeable,  experienced  fie’d  observers. 

1 .  An  Example 

To  illustrate  the  use  of  capability  data,  three  hypothetical  sets  of 
probabilities  have  been  generated  and  are  presented  in  Table  XII.  Each  set 
is  to  be  interpreted  as  applying  to  a  system  represented  by  three  functions 
(Fi,  and  F3)  such  that  Fj  ij  composed  of  three  elements,  and  both  F^ 
and  F3  comprise  four  elements  each.  The  three  sets  of  values  are  totally 
independent  and  may  be  imagined  to  apply  to  three  different  systems,  or 
as  three,  mutually  exclusive  hypothetical  possibilities  for  a  single  system. 

In  any  event,  the  non-pa  renthetical  numbers  represent  the  probabilities 
with  whicl:  humans  can  be  expected  to  perform  the  associated  PEF  Units, 
i.e.,  reliable  human  capability  values.  The  numbers  in  parentheses  are 
derived  (calculated)  values;  those  numbers  represent  required  performance 
levels. 


It  is  assumed  that  the  MSSM  for  each  Function  is  a  simple  multi¬ 
plicative  model,  i.e.,  there  are  no  alternative  routes;  thus,  the  product 
of  the  capability  values  for  the  elements  in  any  one  row  in  Table  XII 
is  equal  to  the  number  under  Sc  in  that  row.  Similarly,  the  product  of  the 
associated  parenthetical,  allocated  values  in  a  single  row  equals  Sr,  the 
operational  requirement.  In  most  of  the  subsequent  discussion,  system 
operational  requirements  (Sr  values)  will  be  compared  with  the  derived 
capability  scores  (Sc  values);  also,  comparisons  will  be  made  between 
allocated  and  capability  values  at  the  PEF  Unit  level.  The  kinds  of  con¬ 
siderations  and  operations  for  the  comparisons  at  the  two  levels  are  quite 
similar. 
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C  ■  r  re  spondin*;  Capability  Level..  a n.»  the  System  Opel  diurnal 
H  epu :  rrmrnt  ^  that  Mint  hr  Met 


Data 

Function 

1 

k  to  in* 

'nt 

Capability 

R  ec|ui  red 

Set 

3 

4 

Sr 

F1 

(.90  3) 

(.  088) 

(.  05  8)1 

•  -  »  • 

.  940 

.  983 

.  071 

.  805  2 

---- 

.  854 

I 

F3 

(.984) 

{.  987) 

(.979) 

(.988) 

.  93q 

.  078 

.  983 

.  970 

.  986 

.  919 

(.990) 

(.  988) 

(.  989) 

(.983) 

.  951 

*  3 

- 

.  982 

.  978 

.  980 

.  964 

.  907 

System 

HU 

.  830 

Fl 

(.957) 

(.  988) 

(.  994) 

-  -  -  - 

.  940 

.  965 

.  990 

.  995 

.... 

.  951 

II 

cv 

(.983) 

(.973) 

(.991) 

(.991) 

.  9  39 

*  2 

.  998 

.  997 

.  999 

.  999 

.  993 

f3 

(.993) 

(.  996) 

(.985) 

(•  976) 

.  95  1 

.  997 

.  998 

.  994 

.  991 

. 

.  980 

— 

Sys 

tern 

.  925 

.  839 

Fl 

(.965) 

(.986) 

(.  988) 

— 

.  940 

.  944 

.  976 

.  981 

.  904 

III 

(.992) 

(.983) 

(.971) 

(■  992) 

.  939 

.  999 

.  998 

.  997 

.  999 

.  993 

f3 

(.992) 

(.981) 

(.990) 

(.987) 

.951 

.  991 

.  975 

.  986 

.  982 

.  936 

System 

.  840 

.  839 

Parentheticdl  numbers  are  derive  allocated  probabilities;  e.g.,  note 
that  (.993)  (.  988)  ( .  958)  =  .  940  =  L r  l or  Fi  of  Set  I. 

Expected  probabilities  of  personnel  performance  obtained  from 
capability  data. 
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The  fii  r  * '  •-  ->*!->  ■{  hvpothe!  nui  1  *  1  ■  >  t .  t  (ivui-oa  mil  lift  k  a  1  .iluc^) 
i.c  ri1  iipncr-Urrl  - *  >  that  (!)  1:;  Jjbl  I,  the  ir  Valui-S  i  m  I'ti'i  i(,  v*Mues;  {c) 
it  Sf't  II,  ill  capability  scorns  art*  larger  than  tin*  cur  responding  required 
values;  nid  (3)  in  Set  III  there  id  one  high  5C  probability  and  two  S,.  values 
that  arc  below  Sr,  but  tire  system  values  are  about  the  same.  It  may  be 
noted  that  the  probabilities  of  accomplishing  system  output  states  are 
obtained  by  multiplying  the  three  values  directly  above  each  of  them;  for 
example,  in  Set  I, 

System  Sr  =  [.  940]  [.919]  (.  95  1]  =  .  839  and 

System  Sc  =  U  354]  [.  9  19]  [.  907]  *  -712 
Z.  Interpretation 

Discrepancies  between  corresponding  Sc  and  Sr  values  --  for  any 
set  of  data  --  may  result  from  one  or  more  of  the  following  conditions: 

a.  Human  capabilities  differ  from  those  required,  and 
changes  in  skill  levels  or  number  of  personnel  are 
indicated  through  modifications  in  training  or 
selection  procedures. 

b.  One  or  more  components  of  the  System  Effectiveness 
Requirement  (SER)  at  one  or  more  levels  of  specificity 
is  incompatible  with  that  which  can  be  achieved  for  the 
system  design  used  in  the  analysis. 

,  A  different  system  design  could  meet  the 
requirements. 

.  The  criteria  used  for  setting  the  SER  do  not 
correspond  to  that  dictated  by  system  context. 

c.  The  SER,  in  combination  with  decision  criteria,  is  set 
unrealistically  high  for  any  conceivable  system  design 
(or  too  low  for  the  system  to  be  useful). 

d.  Decision  criteria  used  in  the  allocation  process  are 
unnecessarily  stringent  or  do  not  correspond  to  actual 
system  context  requirements. 

e.  The  system  may  not  be  appropriately  modelled,  either 
graphically,  mathematically,  or  both. 
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each  Function  would  need  to  be  redesigned.  That  does  not  mean  that  the 
probubi lit y  of  accomplishing  each  element  within  a  given  function  must 
be  increased  as  a  result  of  the  redesign;  it  is  conceivable  that  in  pro¬ 
ducing  a  large  increase  in  the  probabilities  of  accomplishing  some 
elements,  others  n,ay  he  forced  down.  For  example ,  the  probability 
associated  with  Element  4  in  Fi  might  tolerate  a  reduction  of  .001  or 
.002  in  order  to  increase  the  probabilities  for  accomplishing  the  other 
three  elements. 


Similarly,  time  allowances  {where  critical)  may  need  to  be  altered 
by  redesign  in  order  to  increase  probabilities  of  accomplishment.  As  long 
as  the  system  effectiveness  specifications  do  not  state  requirements  at 
the  element  level,  reconstruction  of  the  design  at  that  level  theoretically 
can  assume  any  form.  Of  course,  redesign  must  always  take  into  con¬ 
sideration  such  additionally  specified  decision  criteria  as  personnel 
training  requirements  and  cost. 

It  is  also  conceivable  that  the  original  requirement  of  .  839  is 
highei  than  needed  in  the  system  context.  All  other  things  being  equal,  if 
the  system  could  actually  serve  its  purpose  by  supplying  a  specified  output 
with  a  probability  of  .700  (Sr  =  .700),  then  the  values  in  Set  I  are 
satisfactory  (Sc  =  .7 12), 

Almost  any  effectiveness  requirement  (except  absolute  per¬ 
fection)  could  be  met  if  cost  and  time  to  realize  the  design  were  unlimited. 
However,  restrictions  on  economy  of  all  kinds  normally  set  limits  on  what 
may  reasonably  be  expected  from  a  system.  Considering  the  immense 
number  of  permutations  and  combinations  of  elements  in  a  system,  it  is 
not  a  simple  matter  to  specify  a  general  procedure  for  determining  the 
non-feasibility  of  achieving  system  requirements.  The  decision  may  have 
to  rest  in  the  hands  of  the  responsible  system  designers  who  are  unable  to 
find  alternative  means  of  providing  the  required  system  output  state.  As 
a  result,  either  the  effectiveness  requirements,  the  decision  criteria,  or 
both  may  need  to  be  relaxed  somewhat. 

Just  the  reverse  may  be  true  for  the  system  represented  by  the 
data  in  Set  II  of  Table  V  where  Sr  is  less  than  Sc.  That  condition  could 
arise  if  the  effectiveness  requirement  and/or  decision  criteria  are  more 
relaxed  than  the  system  mission  actually  requires.  On  the  other  hand,  it 
may  well  be  true  that  the  system  mission  can  in  fact  be  accomplished 
successfully  at  the  originally  stated  requirement  level;  Sc  >  Sr  might  then 
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b  r*  thf»  r**«ult  of  rdf* « 1  gn .  Ar,  r  4«»  *  i  gn  ’fldiraterl  bv  1  1'ifC**  di**- 
rri'panty  between  S(  and  f>r  generally  cur  responds  to  in  expend'd ur<  dl 
hardware  or  personnel  (number  or  cap.tb:  litics)  greater  than  neces  sa  ry , 
j.  **.  ,  excess  costs  in  general.  Note,  however,  that  it  may  be  possible 
to  trace  overdesign  to  particular  elements.  For  «  yarnple,  in  Fj  of  Set  11, 
only  Element  1  may  be  overdesigned  while  Element  £  and  3  appear  to 
hav?*  very  similar  allocated  and  capability  probability-  values,  oiitiilitiy , 
the  associated  values  in  Element  <1  of  are  almost  identical. 


When  applying  the  technique  to  an  existing  system,  it  is  in  the 
best  economic  interests  to  investigate  all  possible  sources  of  a  difference 
between  Sc  and  Sr  before  deciding  upon  a  coarse  of  action.  One  source 
which  has  not  been  mentioned  so  far  could  lie  not  in  the  system,  but  in 
the  basis  of  the  decision  that  a  discrepancy  exists.  That  is,  the  system 
may  not  1  ave  been  modeled  accurately,  so  that  an  erroneous  conclusion  is 
drawn.  It  is  likely  that  such  errors  will  occur  less  and  less  frequently 
:a  experience  is  gained  with  the  use  of  the  technique.  However,  in  the 
initial  phases  of  its  application,  some  means  for  double -checking  the 
accuracy  of  the  models  may  be  necessary. 


Considering  Set  III  in  Tabic  XII  it  is  evident  that  if  no  Sr  values 
were  specified  at  the  Function  level,  the  overall  system  effectiveness 
requirement  of  .  839  could  be  met,  as  indicated  by  the  results  of  the 
capability  analysis  (.840).  However,  Function  requirements  are  indicated, 
and  for  two  of  the  Functions  (F^  and  F3)  the  capability  scores  indicate 
inability  to  meet  those  requirements.  That  inability  is  particularly 
reflected  in  Elements  1  and  2  of  Fl  and  Elements  2,  3  and  4  of  F3.  On 
the  other  hand,  the  ability  to  perform  Ti  is  much  greater  than  specifications 
demand. 


Conclusions  and  possible  actions  resulting  from  these  findings  are 
approached  in  the  same  way  as  has  been  discussed  above  where,  for  the 
entire  system,  all  Sc  values  were  higher  or  lower  than  Sr*  values.  How¬ 
ever,  when  some  are  higher  and  some  are  lower,  it  is  less  likely  that 
the  Source  of  the  discrepancies  lies  in  erroneous  modeling,  unless  there 
is  some  reason  to  suspect  that  the  analyst  is  differentially  treating  some 
Functions  with  greater  cars  or  accuracy  than  others.  Also,  where  the 
Function  specifications  are  not  all  met,  but  system  effectiveness  require¬ 
ments  are,  the  added  alternative  exists  to  re-evaluate  the  basis  for 
establishing  requirements  at  the  Function  level.  It  may  be  less  costly  and 
serve  the  purpose  of  the  mission  to  accept  the  overall  system  as  it  stands, 
rather  than  to  seek  a  means  of  revising  elemental  PEF  Units  to  meet  the 
standards  at  the  Function  level. 
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AF’PENDIX  A 


COMPUTER  PROGRAMMING  PROCEDURES 


A.  Introduction 


TEPPS  computer  program  procedures  for  allocating  system 
effectiveness  requirements  among  PEF  Units  defined  in  the  GSSM 
arc  described  here.  As  TEPPS  methodology  is  refined  and  extended, 
the  computer  program  will  be  updated  to  reflect  those  developments. 
However,  highly  flexible  programming  concepts  have  been  employed 
to  minimize  the  effort  required  to  add  or  modify  instructions  to  the 
computer.  That  effect  is  being  achieved  by  designing  a  tree-like 
program  having  a  basic,  central  set  of  "main  program"  operations, 
the  majority  of  which  involve  sequential  selection  of  appropriate 
sub  routines . 


B.  Input 

The  first  computer  operations  directed  by  the  main  program 
are  the  reading  and  storage  of  data,  which  consist  of; 

(1)  the  code  numbers  which  identify  activities  in  the 
Data  Store,  and  the  parameters  (I,  Tlnin  and  Tn,ax) 
aesociatid  with  each  of  those  activities, 

(2)  identification  numbers  and  associated  Data  Store 
code  numbers  of  the  PEF  Uni  s  wnich  appear  in 
the  GhSM  and  which  are  to  receive  allocation 
standards,  and 

(3)  imposed  effectiveness  requirements. 

The  main  program  uses  the  identification  numbers  of  the  system- 
specific  data  to  construct  a  functional  representation  of  the  GSSM  in  the 
computer,  That  representation  is  best  visualized  as  being  like  an 
electronic  switching  network,  with  a  selector  switch  at  the  input  of 
every  set  of  alternative  PEF  Units,  i,  e.  ,  wherever  there  is  an  input 
circle  with  cross  or  triangle  symbol. 
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C.  Ope  rations 


1  ;U  k.  at  iiVUi’y  possible  C  ij  i  1  ibi  Hu  tlG  H  O  i  a  1 1 C  i'  Hail V  C  PEF  UtillM,  t!«i: 
tnain  program  summonH  the  first  subroutine  named  Locator.  Locator 
identifies  each  "chain"  to  be  evaluated.  A  "chain"  is  determined  by  the 
selection  of  a  single  PH F  Unit  from  each  of  the  alternative  sots  which  have 
been  fed  to  the  computer  as  data,  Every  pattern  from  among  alternatives , 
then,  establishes  a  unique  "chain"  or  series  of  activities. 


The  identified  chain  is  then  subjected  to  analysis  under  the  direc¬ 
tion  of  a  second  subroutine  ,  Calc  I,  A  primary  eha  ractc  ristie  of  e n 
isolated  "chain"  is  that  the  probability  nf  its  output  is  the  product  of  the 
probabilities  of  accomplishing  its  component  PEF  Units.  Cale  I,  then, 
maximizes  the  product  of  the  IOTA  values  associated  with  the  PEI'  Unit3 
in  the  chain,  tinder  ti>*  constraint  that  the  sum  of  the  tiroeB  to  perform  those 
units  ia  T„,  the  corrected  over. ill  5ER  on  time  (see  Section  IV.  B). 


each  PEF  Unit,  according  to  equation  (1). 


where: 


rzj  -1/2  x ** 

V 


1/. 


dx 


dx 


(1) 


ij  a  the  variable  index  for  the  j  th  PEF  Unit 

Ij  =  the  LAMA  Data  Store's  maximum  IOTA  for  the  j  th 
PEF  Unit 


x  a  a  dummy  variable 
log  tj  -  Uj 


t;  =  the  time  standard  to  be  allocated  to  perform  the  jth  PEF 
Unit 

Uj  =  1/2  (log  Tmaxj  +  log  Tmmj)  or  the  mean  of  the  logarithmic 
transformation  of  the  ij  distribution  over  time 

Oj  a  1/6  (log  Tmaxj  “  log  Tminj)  or  the  standard  deviation  of 
the  logarithmic  transformation  of  the  ij  distribution  over 
time. 


The  only  constraint  is  that  £tj  <  T0.  If  the  sum  of  minimum 
times  to  accomplish  activities  is  larger  than  T0,  then  all  of  the 
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ij  values  arc  set  equal  to  zero,  and  each  allocated  probability  (pj)  in  the 
chain  is  set  equal  to  the  n  tli  t  u»t  of  P0  (the  SfclR  probability  component), 
That  is,  if  Tmin  >  T(),  then  i j  =s  0  and  pj  =  Pu  The  other  extreme 

is  also  treated  in  a  particular  way;  if  TniJX  <  T0,  ij  =  lj,  so  that 
allocated  probability  values  are,  derived  directly  from  the  IOTA  listed  in 
the  LAMA  Data  Store. 


n 

To  maximize  "  U  ,  for  ti  PLF  Units  in  a  chain, 
jal  J 

calculates  n  equations  of  the  form 


the  computer 


— J—  -  K  (2) 

1! 

J 

where: 

V 

J 

K  =  a  constant  whose  value  is  determined  by  the  n 
equations  and  the  limitation  that  >1  tj  *  TQ. 

The  resulting  ij  and  t:  values  are  stored  in  memory,  and  the  main  program 
is  signalled  that  the  Calc  I  subroutine  has  completed  its  job. 

Calc  II  subroutine  is  then  summoned  to  compute  the  alloc., 
n 

Pj  values  such  that  n  pj  =  PD.  That  is  done  by  substituting  for  pj  the 
conversion  relation  of  equation  (3), 

pj  =  k  +  (1  -  k)  ij  (3) 

In  other  words, 

n  [k  +  (i  -k)ij  =  po  (4) 

j-i 

equation  (4)  is  solved  for  k,  and  then  each  pj  is  determined  by  applying 
equation  (3)  for  every  j. 

When  all  p:  values  have  been  stored,  the  computer  signals  the  primary 
program,  SUPR,  which  directs  seve*al  subroutines  to  print  out  allocated 
Pj  and  tj  values  along  with  identifications  of  their  associated  PFF  Units. 

The  program  requests  Locator  subroutine  V  select  another  chain  after 
A-hich  the  cycle  is  repeated  until  all  chains  have  been  evaluated  and  the 
results  recorded. 
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